Commit Graph

232 Commits

Author SHA1 Message Date
guillaume-be
cb6bc34eb4 Updated borrowing for XLNet, integration tests 2021-08-20 11:08:37 +02:00
guillaume-be
3ff5199376 Updated offsets fixing overlapping spans 2021-08-18 09:07:23 +02:00
guillaume-be
9cadc5d15f Tested and fixed POS tagging on long inputs (requiring breaking input in multiple features) 2021-08-17 09:53:26 +02:00
Guillaume B
466c6b6922 Updated doctests 2021-07-28 18:10:20 +02:00
Guillaume B
ce90d8901d Updated examples and integration tests 2021-07-11 11:13:00 +02:00
Guillaume B
89b3a327fa Moved builder to own module, simplified Marian resource retrieval 2021-07-11 10:08:27 +02:00
Guillaume B
5dc7f33c39 Added MBart50 and M2M100 to supported translation models 2021-07-10 11:34:51 +02:00
Guillaume B
3b72b7cc9b Added example for translation builder, language checks for MBart and M2M100 2021-07-10 10:32:31 +02:00
Guillaume B
450fe0d533 Merge branch 'm2m100_implementation' into translation_rework 2021-07-09 15:41:28 +02:00
Guillaume B
85c05cbe13 Updated Marian translation example 2021-07-07 15:54:28 +02:00
Guillaume B
1c375a817e Use of new language enum in TranslationModel 2021-07-04 12:56:34 +02:00
Guillaume B
58eef0785f Merged master changes 2021-06-28 18:57:27 +02:00
Guillaume B
0b2e339e87 Merge remote-tracking branch 'origin/master' into m2m100_implementation
# Conflicts:
#	Cargo.toml
2021-06-28 18:53:46 +02:00
Guillaume B
2f6b26bb88 Addition of tests for M2M100 2021-06-27 18:18:41 +02:00
Guillaume B
f024350dee Fixed various documentation typos 2021-06-26 11:07:17 +02:00
Guillaume B
9a04d1527a Working example for M2M100 Translation 2021-06-26 10:49:42 +02:00
Guillaume B
f29e02ecbc Addition of TextOutput and IndicesOutput, updated pipelines and tests 2021-06-16 18:15:22 +02:00
Guillaume B
c40a218b37 Initial implementation of scores output 2021-06-15 19:09:20 +02:00
Guillaume B
5907b7d954 Updated documentation, cleaned examples, added integration tests 2021-06-06 13:01:33 +02:00
Guillaume B
d401fea891 Updated tests and docstrings 2021-06-03 10:17:52 +02:00
Guillaume B
a9518c94fa Addition of GPT-Neo 2.7B pretrained weights, added example, updated changelog 2021-05-06 16:57:12 +02:00
Guillaume B
71c196b0ce Updated documentation, fixed Clippy warnings 2021-04-08 14:50:02 +02:00
Guillaume B
4c4ef41a80 Fixed Marian to be compatible with BART refactoring 2021-03-27 18:36:42 +01:00
Guillaume B
5e6b84a7a0 Updated BART embeddings for compatibility with Marian model 2021-03-27 18:03:45 +01:00
Guillaume B
32537da610 Fixed attention value calculation 2021-03-27 16:51:10 +01:00
Guillaume B
b6f722984b updated attention reshape method 2021-03-27 16:05:06 +01:00
Guillaume B
c378b02bbe BART refactoring (initial draft) 2021-03-27 15:55:25 +01:00
Guillaume B
d5321a8940 Updated README and documentation 2021-03-20 17:03:21 +01:00
Guillaume B
65da7afbb6 Update punctuation POS tags with low score 2021-03-15 16:41:00 +01:00
Guillaume B
02819c0a71 initial version of POS tagging pipeline 2021-03-12 09:30:21 +01:00
Guillaume B
6a6bd74533 Fixed Clippy warnings 2021-02-21 08:56:36 +01:00
Guillaume B
545d52ec9d Longformer integration tests 2021-02-16 10:16:09 +01:00
Guillaume B
25392ef19b Reverted DistilBertForQuestionAnswering example 2021-02-14 10:53:00 +01:00
Guillaume B
e9102de7be Fixed LongformerForQuestionAnswering, fixed QA start/end masking 2021-02-14 10:52:11 +01:00
Guillaume B
83afd4ce54 Merge remote-tracking branch 'origin/master' into prophetnet_implementation
# Conflicts:
#	src/pipelines/generation_utils.rs
#	src/pipelines/summarization.rs
2021-01-25 18:25:36 +01:00
Guillaume B
43512134ae Refactored the text generation methods for models to the model definition file 2021-01-23 09:03:27 +01:00
Guillaume B
930a6b4f42 Addition of integration tests for ProphetNet 2021-01-20 17:16:48 +01:00
Guillaume B
9c0edeebf1 Fix and validation of ProphetNet summarization 2021-01-18 12:41:58 +01:00
Guillaume B
732a8e1272 ProphetNetModel output validated 2021-01-16 10:50:27 +01:00
Guillaume B
dbd7469807 Minor fixes for ProphetNetEncoder 2021-01-16 10:30:47 +01:00
Guillaume B
f8ed5079c1 initial commit for ProphetNet 2021-01-07 10:41:50 +01:00
Guillaume B
bf00f90d55 Working MobileBert masked LM 2020-12-19 15:46:33 +01:00
Guillaume B
78eb970679 Updated position ids computation 2020-12-19 15:29:13 +01:00
Guillaume B
0c1af736e2 Addition of MobileBertForMaskedLM 2020-12-19 14:20:32 +01:00
Guillaume B
fed8908a83 Addition of MobileBERT config and resources 2020-12-05 10:01:16 +01:00
Guillaume B
594ac71102 Addition of integration tests for Reformer model 2020-11-15 10:32:10 +01:00
Guillaume B
f3eb2e189f Fixed masking for LSH attention, added pipeline and example 2020-11-15 09:27:06 +01:00
Guillaume B
4678011d29 Working forward pass (long output, no cache) 2020-11-13 17:34:15 +01:00
Guillaume B
3995a3ee92 Working forward pass (short output, no cache) 2020-11-13 16:58:03 +01:00
Guillaume B
aea41062ef Reformer forward pass running (short sequence, no history) 2020-11-13 16:19:47 +01:00