Commit Graph

192 Commits

Author SHA1 Message Date
Guillaume B
43512134ae Refactored the text generation methods for models to the model definition file 2021-01-23 09:03:27 +01:00
Guillaume B
bf00f90d55 Working MobileBert masked LM 2020-12-19 15:46:33 +01:00
Guillaume B
78eb970679 Updated position ids computation 2020-12-19 15:29:13 +01:00
Guillaume B
0c1af736e2 Addition of MobileBertForMaskedLM 2020-12-19 14:20:32 +01:00
Guillaume B
fed8908a83 Addition of MobileBERT config and resources 2020-12-05 10:01:16 +01:00
Guillaume B
594ac71102 Addition of integration tests for Reformer model 2020-11-15 10:32:10 +01:00
Guillaume B
f3eb2e189f Fixed masking for LSH attention, added pipeline and example 2020-11-15 09:27:06 +01:00
Guillaume B
4678011d29 Working forward pass (long output, no cache) 2020-11-13 17:34:15 +01:00
Guillaume B
3995a3ee92 Working forward pass (short output, no cache) 2020-11-13 16:58:03 +01:00
Guillaume B
aea41062ef Reformer forward pass running (short sequence, no history) 2020-11-13 16:19:47 +01:00
Guillaume B
8ec1704ff1 Fixed weights loading error 2020-11-10 08:24:38 +01:00
Guillaume B
ed346d34ac Definition and loading of Reformer config 2020-11-01 09:40:53 +01:00
Guillaume B
6ebfb7a98c Created a specific TextGenerationConfig for the TextGenerationModel 2020-10-30 18:26:39 +01:00
Guillaume B
4b11d7b76c Updated documentation, kept GenerateConfig unchanged for backward compatibility 2020-10-28 17:37:51 +01:00
Guillaume B
3d4bb6535d Updated integration tests 2020-10-27 18:52:48 +01:00
Guillaume B
297c9d2c8d Addition of TextGenerationModel 2020-10-27 18:22:34 +01:00
Guillaume B
ec766b1714 Addition of integration test for T5-based summarization 2020-10-25 09:10:56 +01:00
Guillaume B
ef8c8f84db Extended summarization pipeline to align with Enum unpacking, added support for T5 summarization 2020-10-25 09:04:30 +01:00
Guillaume B
3c6f35ea06 Merge branch 'master' into updated_tokenizers
# Conflicts:
#	src/pipelines/zero_shot_classification.rs
2020-10-23 16:47:11 +02:00
Guillaume B
a22c89b010 Fixed greedy generation method 2020-10-13 18:52:09 +02:00
Guillaume B
fbff61507a Updated README 2020-10-13 07:14:00 +02:00
Guillaume B
97ee8ee928 Generalization of input types for pipelines 2020-10-11 16:18:44 +02:00
Guillaume B
9e1887e0f6 Compatibility with updated tokenizers crate 2020-10-10 12:46:43 +02:00
Guillaume B
6dde3241a2 initial docs for XLNet 2020-10-01 19:13:04 +02:00
Guillaume B
2ce687cd1e Addition of integration tests for XLNet 2020-09-24 18:49:05 +02:00
Guillaume B
0fe17cacb4 Fixed beam_search generation with XLNet 2020-09-20 12:02:17 +02:00
Guillaume B
95d3bf5a53 Updated generation for XLNet 2020-09-19 17:31:56 +02:00
Guillaume B
536b0b02db updated relative shift 2020-09-18 17:41:28 +02:00
Guillaume B
7db7b2b34c updated weights shape 2020-09-18 17:12:07 +02:00
Guillaume B
abe177c1c6 XLNetModel forward pass implemented 2020-09-18 16:41:29 +02:00
Guillaume B
6f907ff995 Merge branch 'master' of https://github.com/guillaume-be/rust-bert into xlnet_implementation 2020-09-16 17:19:22 +02:00
Guillaume B
b9e221f322 Merge branch 'master' into xlnet_implementation 2020-09-16 17:17:00 +02:00
Guillaume B
93277439e5 Updated documentation and RoBERTa model ouputs 2020-09-15 17:45:39 +02:00
guillaume-be
59e6cb54f0 updated ALBERT documentation 2020-09-14 18:33:58 +02:00
Guillaume B
47d9a1017d Updated T5 (clippy) 2020-09-13 12:25:22 +02:00
Guillaume B
6cef45787d Updated generation (clippy) 2020-09-13 11:08:49 +02:00
Guillaume B
5aa1e635ba Updated BERT and DistilBERT (clippy) 2020-09-12 17:12:49 +02:00
Guillaume B
7e9d6d7e39 Updated Bart & Marian (clippy warnings) 2020-09-12 16:17:58 +02:00
Guillaume B
daa6dba2d2 Updated Albert (clippy warnings) 2020-09-12 15:11:56 +02:00
Evan Pete Walsh
34e061c0de
add cached-path file utils (#74)
* add cached-path

* updates

* fix typo, add deprecation notice

* fix up

* update cached-path dependency

* update cached-path

* remove usage of 'download_resource' in examples

* clean up
2020-09-12 13:47:23 +02:00
Guillaume B
64320b55c8 Initial commit for XLNetRelativeAttention 2020-09-10 18:10:54 +02:00
Guillaume B
eabab31aa3 Definition of XLNet configuration 2020-09-08 16:47:45 +02:00
Guillaume B
6e9a0310e3 Updated examples and tests for zero shot classification
Multilabel example for zero-shot classification
2020-09-06 10:39:18 +02:00
Guillaume B
080efc6791 Formatting update 2020-09-06 10:28:32 +02:00
Guillaume B
5a833c7caa Moved csv to dev dependencies 2020-09-06 10:27:29 +02:00
Guillaume B
b52b0cb005 Addition of integration tests for zero-shot classification 2020-09-05 15:02:34 +02:00
Guillaume B
56747f7033 reversed error handling for pipelines to maintain backward compatibility 2020-09-01 18:00:38 +02:00
Guillaume B
71121e56d8 Addition of BART as an option for sequence classification pipelines, updated return type of pipelines to be a Result 2020-09-01 17:52:49 +02:00
Guillaume B
c6886096d2 Updated summarization output resulting from tokenization updates 2020-08-30 10:18:38 +02:00
Guillaume B
50ee1a1e4e Updated for additional tokenizer settings & configuration validity check 2020-08-30 09:35:38 +02:00