Commit Graph

283 Commits

Author SHA1 Message Date
Guillaume B
944e825a14 Definition of BART EncoderLayer 2020-03-30 17:59:22 +02:00
Guillaume B
074054ea58 initial implementation of attention with caching 2020-03-30 17:38:36 +02:00
Guillaume B
44a83ad4ab initial draft for cached attention 2020-03-29 19:31:12 +02:00
Guillaume B
efd2ed0509 BART config & initial input preparation 2020-03-29 12:01:13 +02:00
guillaume-be
6f98655832
Merge pull request #16 from guillaume-be/improved_documentation
Improved documentation
2020-03-27 16:50:38 +01:00
Guillaume B
f8949ad845 Doctest update 2020-03-27 16:19:33 +01:00
Guillaume B
eea1667f26 Added documentation for pipelines 2020-03-27 16:17:17 +01:00
Guillaume B
769584461f Documentation for Pipelines, updated visibility for generator trait 2020-03-27 10:51:17 +01:00
Guillaume B
9a647a40da Completed documentation for GPT 2020-03-27 09:34:26 +01:00
Guillaume B
2263b9fb86 Completed documentation for GPT2 2020-03-27 09:23:07 +01:00
Guillaume B
c1e0823ee1 Completed documentation for RoBERTa 2020-03-25 19:05:01 +01:00
Guillaume B
496f7ba0bb Completed documentation for DistilBERT 2020-03-24 19:59:00 +01:00
Guillaume B
6c6e5526ec Completed documentation for BERT 2020-03-22 15:39:22 +01:00
Guillaume B
e1f3b743da BERT documentation (ongoing) 2020-03-22 11:56:58 +01:00
Guillaume B
54b10c54a7 Updated lib structure and visibility 2020-03-22 09:54:49 +01:00
Guillaume B
f17b0d7da8 Lib clean-up and doc landing page 2020-03-21 16:53:15 +01:00
Guillaume B
24335a5883 Lib clean-up (default binary deleted, re-exports removed) 2020-03-21 11:35:41 +01:00
Guillaume B
56bf0f7691 Improved error message for examples 2020-03-19 18:28:56 +01:00
guillaume-be
d43c58a0f3
Merge pull request #15 from guillaume-be/generation_optimization
Performance optimization for language generation
2020-03-17 20:35:57 +01:00
Guillaume B
344e27c927 Performance optimization for language generation 2020-03-17 20:06:45 +01:00
guillaume-be
3ccfc05d92
Updated generation (#14) 2020-03-16 21:45:20 +01:00
guillaume-be
7c6e71155a
Merge pull request #13 from guillaume-be/generation
Natural Language Generation
2020-03-16 16:59:11 +01:00
Guillaume B
1efe107bd3 End-to-end generation completed, updated README, bumped version 2020-03-16 16:27:12 +01:00
Guillaume B
64a01e3f73 End-to-end generation completed, updated README, bumped version 2020-03-16 16:17:23 +01:00
Guillaume B
5539e9360a Beam population loop 2020-03-16 12:38:49 +01:00
Guillaume B
2dbdb2c2be beam search preparation 2020-03-16 09:46:17 +01:00
Guillaume B
2621e0dc5d Added tests for GPT2 and OpenAI GPT generation 2020-03-15 21:09:46 +01:00
Guillaume B
e572cdb61a End to end generation without beam search 2020-03-15 20:54:21 +01:00
Guillaume B
6e61a54a0f Update of input ids, stop if eos_id and update attention mask 2020-03-15 20:04:36 +01:00
Guillaume B
c2ff52c217 Addition of top_k top_p sampling 2020-03-12 22:30:31 +01:00
Guillaume B
2241f8c01f banned tokens and min length implemented 2020-03-12 20:49:22 +01:00
Guillaume B
b6e186b7b0 Initial implementation of banned tokens detection 2020-03-12 18:49:45 +01:00
Guillaume B
61721ee2b8 Updated generation based on latest Transformers update (preparation) 2020-03-11 19:31:53 +01:00
Guillaume B
de86e57ee9 Updated generation based on latest Transformers update 2020-03-11 19:17:53 +01:00
Guillaume B
dd3415bbc1 Added repetition penalty 2020-03-10 20:58:18 +01:00
Guillaume B
c7727b0b97 Model forward pass for generation & GPT2 fix 2020-03-10 18:50:22 +01:00
Guillaume B
8f044b5bcc Updated generation preparation 2020-03-09 20:35:29 +01:00
Guillaume B
16a1059a76 Updated copyright 2020-03-08 17:58:02 +01:00
Guillaume B
2d63fc3d18 Added tests for GPT2 2020-03-08 17:55:47 +01:00
Guillaume B
c98b689297 GPT2 download 2020-03-08 17:50:57 +01:00
Guillaume B
1923af0ac7 initial structure for generation 2020-03-08 17:08:18 +01:00
Guillaume B
4866223e88 Updated QA example 2020-03-07 18:13:26 +01:00
guillaume-be
e9ac97b705
Merge pull request #11 from guillaume-be/qa_batch_input
Question Answering batched input
2020-03-07 18:12:02 +01:00
Guillaume B
ebce3a9730 Updated README 2020-03-07 17:48:56 +01:00
Guillaume B
596e0efc0e Added error message for SQuAD dataset environment variable 2020-03-07 15:49:09 +01:00
Guillaume B
123d90c40d Updated SQuAD example 2020-03-07 15:46:27 +01:00
Guillaume B
996fdb159f Updated QA for improved batching 2020-03-07 15:21:02 +01:00
Guillaume B
20bd0108c3 addition of SQuAD processor 2020-03-07 11:23:05 +01:00
Guillaume B
999f6e52aa initial commit for batch processing of QA inputs 2020-03-06 21:40:32 +01:00
guillaume-be
4935437891
Merge pull request #10 from guillaume-be/gpt_implementation
Gpt implementation
2020-03-01 12:02:34 +01:00