Commit Graph

478 Commits

Author SHA1 Message Date
Guillaume B
297c9d2c8d Addition of TextGenerationModel 2020-10-27 18:22:34 +01:00
Guillaume B
b09bc9c118 Made tokenizer options more flexible 2020-10-27 17:28:32 +01:00
Guillaume B
4de8e99b0b Generalization of ConversationPipeline, addition of GPT2 and GPT to ModelTypes 2020-10-25 14:57:40 +01:00
Guillaume B
04366f9408 use TokenizerOptiosn in generate 2020-10-25 13:06:51 +01:00
Guillaume B
ec766b1714 Addition of integration test for T5-based summarization 2020-10-25 09:10:56 +01:00
Guillaume B
ef8c8f84db Extended summarization pipeline to align with Enum unpacking, added support for T5 summarization 2020-10-25 09:04:30 +01:00
guillaume-be
3ff09f61ac
Merge pull request #90 from guillaume-be/updated_tokenizers
Updated tokenizers version
2020-10-24 14:39:50 +02:00
Guillaume B
1a23a929f4 Fixed Clippy warning 2020-10-24 11:47:45 +02:00
Guillaume B
49cf07684d resolve merge conflicts 2020-10-23 16:57:37 +02:00
Guillaume B
160d604485 Merge remote-tracking branch 'origin/master' into updated_tokenizers
# Conflicts:
#	src/pipelines/conversation.rs
2020-10-23 16:53:40 +02:00
Guillaume B
adde7cb7b4 resolve merge conflicts 2020-10-23 16:51:24 +02:00
Guillaume B
3c6f35ea06 Merge branch 'master' into updated_tokenizers
# Conflicts:
#	src/pipelines/zero_shot_classification.rs
2020-10-23 16:47:11 +02:00
Guillaume B
3571058a92 Updated docs & dependencies 2020-10-23 16:43:58 +02:00
guillaume-be
d01e87f305
Merge pull request #89 from guillaume-be/updated_conversation_history
Added possibility to reload a conversation from a snapshot
2020-10-19 18:00:35 +02:00
Guillaume B
2db5ac1945 Fixed history loading ending with a response 2020-10-17 17:55:51 +02:00
Guillaume B
642b30d508 Fixed clippy checks 2020-10-17 16:32:11 +02:00
Guillaume B
7b84ff5c47 Added possibility to reload a conversation from a snapshot 2020-10-17 16:04:36 +02:00
Guillaume B
851863482c Support all multithreaded tokenizers 2020-10-17 11:19:03 +02:00
guillaume-be
f7da9dcee4
Merge pull request #86 from guillaume-be/fix_greedy_generation
Fixed greedy generation method
2020-10-14 16:12:04 +02:00
Guillaume B
a22c89b010 Fixed greedy generation method 2020-10-13 18:52:09 +02:00
Guillaume B
989bcec727 Fixed greedy generation method 2020-10-13 08:47:47 +02:00
Guillaume B
fbff61507a Updated README 2020-10-13 07:14:00 +02:00
Guillaume B
97ee8ee928 Generalization of input types for pipelines 2020-10-11 16:18:44 +02:00
Guillaume B
426430ae0b Removed unused import 2020-10-10 13:16:56 +02:00
Guillaume B
9e1887e0f6 Compatibility with updated tokenizers crate 2020-10-10 12:46:43 +02:00
guillaume-be
d73965036c
Merge pull request #84 from guillaume-be/xlnet_implementation
Xlnet implementation
2020-10-04 17:54:26 +02:00
Guillaume B
1b3711e477 Addition of documentation and clippy fixes 2020-10-04 17:10:15 +02:00
guillaume-be
73e20aabfd
Merge pull request #83 from guillaume-be/t5_minor_fixes
T5 minor fixes
2020-10-03 13:30:17 +02:00
Guillaume B
6dde3241a2 initial docs for XLNet 2020-10-01 19:13:04 +02:00
Guillaume B
ce7333cd48 Simplified past handling (see https://github.com/huggingface/transformers/pull/7474) 2020-09-30 18:29:46 +02:00
Guillaume B
7ebf4d2f88 Merge remote-tracking branch 'origin/master' into t5_minor_fixes 2020-09-30 18:27:48 +02:00
Guillaume B
724f467071 Updated attention mechanism (see https://github.com/huggingface/transformers/pull/7474) 2020-09-30 18:23:06 +02:00
Guillaume B
b0d04da8f5 Finalization of integration tests for XLNet 2020-09-29 18:15:33 +02:00
Guillaume B
e28fd26b01 Merge remote-tracking branch 'origin/master' into xlnet_implementation 2020-09-29 17:20:28 +02:00
guillaume-be
2bf14ec322
Merge pull request #81 from guillaume-be/optim
- Generation optimizations
- Addition of benchmark files
2020-09-29 17:15:11 +02:00
Guillaume B
8566cb8cae Addition of benches 2020-09-28 18:29:43 +02:00
Guillaume B
8c6a2ba2e3 Generation (beam search) optimization 2020-09-28 17:25:39 +02:00
Guillaume B
9f0bbd28c5 benchmark tryouts 2020-09-28 08:57:48 +02:00
Guillaume B
9a012ef6ae Addition of XLNet to pipelines 2020-09-24 20:14:58 +02:00
Guillaume B
2ce687cd1e Addition of integration tests for XLNet 2020-09-24 18:49:05 +02:00
Guillaume B
e03b734f25 More idiomatic default options handling 2020-09-23 20:31:57 +02:00
Guillaume B
b48dddc5d7 Addition of XLNet model heads 2020-09-23 17:39:44 +02:00
Guillaume B
8c6bb28df8 Initialization of XLNetForSequenceClassification 2020-09-22 21:18:58 +02:00
Guillaume B
bc2b9ad510 Addition of SequenceSummary forward pass 2020-09-21 20:46:10 +02:00
Guillaume B
1d04f78ed8 Harmonized activations throughout crate 2020-09-21 20:22:52 +02:00
Guillaume B
d84c9fdbdf Initial commit for SequenceSummary 2020-09-21 19:04:58 +02:00
Guillaume B
0fe17cacb4 Fixed beam_search generation with XLNet 2020-09-20 12:02:17 +02:00
Guillaume B
8d0d222444 Implemented generation for XLNet 2020-09-20 10:28:08 +02:00
Guillaume B
6d6c7ea462 Updated past storage 2020-09-19 19:09:27 +02:00
Guillaume B
95d3bf5a53 Updated generation for XLNet 2020-09-19 17:31:56 +02:00