Commit Graph

406 Commits

Author SHA1 Message Date
Guillaume B
5b00074ab5 Addition of integration test for XLMRoberta for NER (German) 2020-07-23 19:34:52 +02:00
Guillaume B
52f43a3c47 Updated prefixes for T5 2020-07-23 19:29:49 +02:00
Guillaume B
b8868766e2 Updated path for XLMRoberta model resources 2020-07-23 19:29:24 +02:00
guillaume-be
b27918a88e
Merge pull request #64 from guillaume-be/Fixed_generation_masking
Fixed generation masking
2020-07-22 18:33:55 +00:00
Guillaume B
40b7344675 Updated mask type for substraction compatibility 2020-07-22 19:56:27 +02:00
Guillaume B
9c08efa34b Updated attention masks for Marian / BART generation without beam search 2020-07-22 19:32:09 +02:00
Guillaume B
4b2b797c39 Addition of languages for NER pipeline 2020-07-21 23:03:37 +02:00
Guillaume B
8ae4a7d64f Addition of XLMRoberta option 2020-07-20 19:50:42 +02:00
Guillaume B
65135227cf Updated dependencies download script for transformers>=2.10 2020-07-20 19:30:19 +02:00
guillaume-be
73571e9b92
Merge pull request #63 from guillaume-be/Updated_multi_turn_conversation
Updated multi turn conversation
2020-07-17 18:25:33 +02:00
Guillaume B
a4a2299619 Updated CI to check formatting on stable 2020-07-17 17:48:12 +02:00
Guillaume B
7a3a3c92d0 Updated truncation to cut off at EOS tokens only 2020-07-17 17:18:03 +02:00
Guillaume B
4f4649068d Updated padding cleaning history to also remove leading padding 2020-07-14 18:49:04 +02:00
Guillaume B
7bf6671a2a Addition of a minimum length for available responses and truncation of conversations if max allowed length is exceeded 2020-07-13 18:06:09 +02:00
guillaume-be
fbd04ad99d
Merge pull request #62 from guillaume-be/generalized_qa_patch
Generalized qa patch
2020-07-12 10:11:16 +02:00
Guillaume B
c9262a310a Addition of integration tests for BERT and RoBERTa QA 2020-07-12 09:49:22 +02:00
Guillaume B
b5335824bc Addition of pretrained Roberta model for question answering 2020-07-12 09:41:20 +02:00
Guillaume B
ec54a213ad Addition of Albert to pipeline options 2020-07-12 09:35:06 +02:00
Guillaume B
8f10d457a1 Updated BERT_QA model uri 2020-07-10 17:21:10 +02:00
guillaume-be
d758595f64
Merge pull request #61 from guillaume-be/question_answering_generalization
Question answering generalization
2020-07-09 16:39:05 +02:00
Guillaume B
b4c0e49d33 Updated QA pipeline to support Roberta models 2020-07-09 13:14:10 +02:00
Guillaume B
e6938e1dcb Addition of BERT option for QA 2020-07-08 21:59:31 +02:00
guillaume-be
4241798bcb
Merge pull request #60 from guillaume-be/t5_implementation
T5 implementation
2020-07-08 21:55:16 +02:00
Guillaume B
e732d76566 Updated config dependency for T5 2020-07-08 21:38:16 +02:00
Guillaume B
2dad825586 Extended language model support for question answering 2020-07-08 21:33:54 +02:00
Guillaume B
3fab076a57 Added documentation 2020-07-08 19:45:32 +02:00
Guillaume B
154fe2a4d0 Added integration tests for T5 and dependencies download 2020-07-07 19:29:45 +02:00
Guillaume B
1e865ef6eb Addition of T5_BASE dependency and download script 2020-07-07 18:15:15 +02:00
Guillaume B
a6b11d5449 Implementation of generation for T5 2020-07-07 18:07:31 +02:00
Guillaume B
7938abc76d Implementation of T5ForConditionalGeneration 2020-07-06 17:43:27 +02:00
Guillaume B
857b4bf7a5 Updated T5 attention, base model output validated w/o cache 2020-07-05 17:49:27 +02:00
Guillaume B
fde80e4470 Updated T5 model, weights loading 2020-07-05 12:27:26 +02:00
Guillaume B
ddddd8e58b Addition of T5Model and fixed layer norms 2020-07-05 12:18:45 +02:00
Guillaume B
2727783ced Addition of T5Stack layer 2020-07-05 11:22:27 +02:00
Guillaume B
55ab1e159b Addition of T5Block layer 2020-07-05 09:43:34 +02:00
Guillaume B
12623543b2 Addition of T5LayerCrossAttention layer 2020-07-05 09:10:12 +02:00
Guillaume B
b7c6874f65 Addition of T5LayerSelfAttention layer 2020-07-02 18:05:30 +02:00
Guillaume B
9bc73e569d Addition of T5LayerFF layer 2020-07-02 17:52:22 +02:00
Guillaume B
bc8e156cd8 Addition of T5DenseReluDense layer 2020-07-02 17:44:16 +02:00
Guillaume B
881868140a Initian implementation of T5Attention 2020-07-01 20:47:25 +02:00
Guillaume B
d72e414521 Intermediate implementation of T5Attention 2020-07-01 18:32:43 +02:00
Guillaume B
b7ad612282 Addition of T5LayerNorm 2020-07-01 16:44:10 +02:00
Guillaume B
b835ccd6a0 Merge remote-tracking branch 'remotes/origin/master' into t5_implementation 2020-07-01 16:27:52 +02:00
Guillaume B
3e0ad01a3b Updated contribution guidelines 2020-06-30 20:24:31 +02:00
Guillaume B
8eb74e5014 Addition of contribution guidelines 2020-06-30 20:20:33 +02:00
guillaume-be
7a8e1f5de3
Merge pull request #59 from guillaume-be/update_path_patch
Updated tch::nn::Path handling to be consistent across crate
2020-06-30 20:04:44 +02:00
Guillaume B
afa03cd46e Updated tch::nn::Path handling to be consistent across crate 2020-06-30 19:47:08 +02:00
guillaume-be
a067faf574
Merge pull request #58 from jerry73204/generic-path
Generic path argument
2020-06-30 19:20:06 +02:00
Guillaume B
8e7696ff27 T5 dependencies download and configuration setup 2020-06-30 19:11:40 +02:00
jerry73204
4095545f64 Use generic path 2020-06-29 16:44:49 +08:00