Commit Graph

216 Commits

Author SHA1 Message Date
Guillaume B
f024350dee Fixed various documentation typos 2021-06-26 11:07:17 +02:00
Guillaume B
9a04d1527a Working example for M2M100 Translation 2021-06-26 10:49:42 +02:00
Guillaume B
5907b7d954 Updated documentation, cleaned examples, added integration tests 2021-06-06 13:01:33 +02:00
Guillaume B
d401fea891 Updated tests and docstrings 2021-06-03 10:17:52 +02:00
Guillaume B
a9518c94fa Addition of GPT-Neo 2.7B pretrained weights, added example, updated changelog 2021-05-06 16:57:12 +02:00
Guillaume B
71c196b0ce Updated documentation, fixed Clippy warnings 2021-04-08 14:50:02 +02:00
Guillaume B
4c4ef41a80 Fixed Marian to be compatible with BART refactoring 2021-03-27 18:36:42 +01:00
Guillaume B
5e6b84a7a0 Updated BART embeddings for compatibility with Marian model 2021-03-27 18:03:45 +01:00
Guillaume B
32537da610 Fixed attention value calculation 2021-03-27 16:51:10 +01:00
Guillaume B
b6f722984b updated attention reshape method 2021-03-27 16:05:06 +01:00
Guillaume B
c378b02bbe BART refactoring (initial draft) 2021-03-27 15:55:25 +01:00
Guillaume B
d5321a8940 Updated README and documentation 2021-03-20 17:03:21 +01:00
Guillaume B
65da7afbb6 Update punctuation POS tags with low score 2021-03-15 16:41:00 +01:00
Guillaume B
02819c0a71 initial version of POS tagging pipeline 2021-03-12 09:30:21 +01:00
Guillaume B
6a6bd74533 Fixed Clippy warnings 2021-02-21 08:56:36 +01:00
Guillaume B
545d52ec9d Longformer integration tests 2021-02-16 10:16:09 +01:00
Guillaume B
25392ef19b Reverted DistilBertForQuestionAnswering example 2021-02-14 10:53:00 +01:00
Guillaume B
e9102de7be Fixed LongformerForQuestionAnswering, fixed QA start/end masking 2021-02-14 10:52:11 +01:00
Guillaume B
83afd4ce54 Merge remote-tracking branch 'origin/master' into prophetnet_implementation
# Conflicts:
#	src/pipelines/generation_utils.rs
#	src/pipelines/summarization.rs
2021-01-25 18:25:36 +01:00
Guillaume B
43512134ae Refactored the text generation methods for models to the model definition file 2021-01-23 09:03:27 +01:00
Guillaume B
930a6b4f42 Addition of integration tests for ProphetNet 2021-01-20 17:16:48 +01:00
Guillaume B
9c0edeebf1 Fix and validation of ProphetNet summarization 2021-01-18 12:41:58 +01:00
Guillaume B
732a8e1272 ProphetNetModel output validated 2021-01-16 10:50:27 +01:00
Guillaume B
dbd7469807 Minor fixes for ProphetNetEncoder 2021-01-16 10:30:47 +01:00
Guillaume B
f8ed5079c1 initial commit for ProphetNet 2021-01-07 10:41:50 +01:00
Guillaume B
bf00f90d55 Working MobileBert masked LM 2020-12-19 15:46:33 +01:00
Guillaume B
78eb970679 Updated position ids computation 2020-12-19 15:29:13 +01:00
Guillaume B
0c1af736e2 Addition of MobileBertForMaskedLM 2020-12-19 14:20:32 +01:00
Guillaume B
fed8908a83 Addition of MobileBERT config and resources 2020-12-05 10:01:16 +01:00
Guillaume B
594ac71102 Addition of integration tests for Reformer model 2020-11-15 10:32:10 +01:00
Guillaume B
f3eb2e189f Fixed masking for LSH attention, added pipeline and example 2020-11-15 09:27:06 +01:00
Guillaume B
4678011d29 Working forward pass (long output, no cache) 2020-11-13 17:34:15 +01:00
Guillaume B
3995a3ee92 Working forward pass (short output, no cache) 2020-11-13 16:58:03 +01:00
Guillaume B
aea41062ef Reformer forward pass running (short sequence, no history) 2020-11-13 16:19:47 +01:00
Guillaume B
8ec1704ff1 Fixed weights loading error 2020-11-10 08:24:38 +01:00
Guillaume B
ed346d34ac Definition and loading of Reformer config 2020-11-01 09:40:53 +01:00
Guillaume B
6ebfb7a98c Created a specific TextGenerationConfig for the TextGenerationModel 2020-10-30 18:26:39 +01:00
Guillaume B
4b11d7b76c Updated documentation, kept GenerateConfig unchanged for backward compatibility 2020-10-28 17:37:51 +01:00
Guillaume B
3d4bb6535d Updated integration tests 2020-10-27 18:52:48 +01:00
Guillaume B
297c9d2c8d Addition of TextGenerationModel 2020-10-27 18:22:34 +01:00
Guillaume B
ec766b1714 Addition of integration test for T5-based summarization 2020-10-25 09:10:56 +01:00
Guillaume B
ef8c8f84db Extended summarization pipeline to align with Enum unpacking, added support for T5 summarization 2020-10-25 09:04:30 +01:00
Guillaume B
3c6f35ea06 Merge branch 'master' into updated_tokenizers
# Conflicts:
#	src/pipelines/zero_shot_classification.rs
2020-10-23 16:47:11 +02:00
Guillaume B
a22c89b010 Fixed greedy generation method 2020-10-13 18:52:09 +02:00
Guillaume B
fbff61507a Updated README 2020-10-13 07:14:00 +02:00
Guillaume B
97ee8ee928 Generalization of input types for pipelines 2020-10-11 16:18:44 +02:00
Guillaume B
9e1887e0f6 Compatibility with updated tokenizers crate 2020-10-10 12:46:43 +02:00
Guillaume B
6dde3241a2 initial docs for XLNet 2020-10-01 19:13:04 +02:00
Guillaume B
2ce687cd1e Addition of integration tests for XLNet 2020-09-24 18:49:05 +02:00
Guillaume B
0fe17cacb4 Fixed beam_search generation with XLNet 2020-09-20 12:02:17 +02:00