guillaume-be/rust-bert
1
1
Fork 0
mirror of https://github.com/guillaume-be/rust-bert.git synced 2024-08-16 16:10:25 +03:00
Code Issues Packages Projects Releases Wiki Activity
1,109 Commits 5 Branches 0 Tags 5.8 MiB
main
Commit Graph

266 Commits

Author SHA1 Message Date
Guillaume B
fe529b2fec BartModel forward pass validated 2020-04-02 14:48:28 +02:00
Guillaume B
642874b22b BartModel implemented and weights loaded 2020-04-02 11:16:50 +02:00
Guillaume B
44a83ad4ab initial draft for cached attention 2020-03-29 19:31:12 +02:00
Guillaume B
efd2ed0509 BART config & initial input preparation 2020-03-29 12:01:13 +02:00
Guillaume B
eea1667f26 Added documentation for pipelines 2020-03-27 16:17:17 +01:00
Guillaume B
496f7ba0bb Completed documentation for DistilBERT 2020-03-24 19:59:00 +01:00
Guillaume B
6c6e5526ec Completed documentation for BERT 2020-03-22 15:39:22 +01:00
Guillaume B
e1f3b743da BERT documentation (ongoing) 2020-03-22 11:56:58 +01:00
Guillaume B
54b10c54a7 Updated lib structure and visibility 2020-03-22 09:54:49 +01:00
Guillaume B
f17b0d7da8 Lib clean-up and doc landing page 2020-03-21 16:53:15 +01:00
Guillaume B
24335a5883 Lib clean-up (default binary deleted, re-exports removed) 2020-03-21 11:35:41 +01:00
Guillaume B
56bf0f7691 Improved error message for examples 2020-03-19 18:28:56 +01:00
Guillaume B
344e27c927 Performance optimization for language generation 2020-03-17 20:06:45 +01:00
Guillaume B
64a01e3f73 End-to-end generation completed, updated README, bumped version 2020-03-16 16:17:23 +01:00
Guillaume B
5539e9360a Beam population loop 2020-03-16 12:38:49 +01:00
Guillaume B
2dbdb2c2be beam search preparation 2020-03-16 09:46:17 +01:00
Guillaume B
2621e0dc5d Added tests for GPT2 and OpenAI GPT generation 2020-03-15 21:09:46 +01:00
Guillaume B
e572cdb61a End to end generation without beam search 2020-03-15 20:54:21 +01:00
Guillaume B
6e61a54a0f Update of input ids, stop if eos_id and update attention mask 2020-03-15 20:04:36 +01:00
Guillaume B
c2ff52c217 Addition of top_k top_p sampling 2020-03-12 22:30:31 +01:00
Guillaume B
b6e186b7b0 Initial implementation of banned tokens detection 2020-03-12 18:49:45 +01:00
Guillaume B
61721ee2b8 Updated generation based on latest Transformers update (preparation) 2020-03-11 19:31:53 +01:00
Guillaume B
de86e57ee9 Updated generation based on latest Transformers update 2020-03-11 19:17:53 +01:00
Guillaume B
dd3415bbc1 Added repetition penalty 2020-03-10 20:58:18 +01:00
Guillaume B
c7727b0b97 Model forward pass for generation & GPT2 fix 2020-03-10 18:50:22 +01:00
Guillaume B
8f044b5bcc Updated generation preparation 2020-03-09 20:35:29 +01:00
Guillaume B
2d63fc3d18 Added tests for GPT2 2020-03-08 17:55:47 +01:00
Guillaume B
c98b689297 GPT2 download 2020-03-08 17:50:57 +01:00
Guillaume B
1923af0ac7 initial structure for generation 2020-03-08 17:08:18 +01:00
Guillaume B
596e0efc0e Added error message for SQuAD dataset environment variable 2020-03-07 15:49:09 +01:00
Guillaume B
123d90c40d Updated SQuAD example 2020-03-07 15:46:27 +01:00
Guillaume B
996fdb159f Updated QA for improved batching 2020-03-07 15:21:02 +01:00
Guillaume B
20bd0108c3 addition of SQuAD processor 2020-03-07 11:23:05 +01:00
Guillaume B
999f6e52aa initial commit for batch processing of QA inputs 2020-03-06 21:40:32 +01:00
Guillaume B
89b486fb12 Added integration test for OpenAI GPT 2020-03-01 11:29:57 +01:00
Guillaume B
d820ea8eea End-to-end OpenAI GPT model implemented 2020-03-01 11:26:34 +01:00
Guillaume B
ad1dbfcbc2 Initial commit for GPT model 2020-03-01 10:59:48 +01:00
Guillaume B
7a9cf64c20 Completed GPT2 example and integration test 2020-02-29 16:07:47 +01:00
Guillaume B
d038626d37 Updated GPT2 implementation, validated 2020-02-29 14:13:08 +01:00
Guillaume B
a276e65cf4 GPT2 Model implemented 2020-02-29 11:39:19 +01:00
Guillaume B
c12c0c479e Calculation of GPT2 embeddings 2020-02-29 10:56:56 +01:00
Guillaume B
811b0ad483 Implementation of Transformer Block 2020-02-28 21:09:42 +01:00
Guillaume B
e15dfe127d Implementation of Attention 2020-02-28 20:28:33 +01:00
Guillaume B
b0e84fc2b9 initial commit for GPT2 2020-02-27 18:55:17 +01:00
Guillaume B
aa819284df updated license headers 2020-02-25 18:39:08 +01:00
Guillaume B
fe4f7c689d Updated README, bumped version 2020-02-25 18:37:02 +01:00
Guillaume B
afa606152b End to end question answering pipeline implemented 2020-02-25 18:32:26 +01:00
Guillaume B
ae11677e2d Updated position embeddings, features stacking and sinusoidal embeddings config overwrite 2020-02-25 16:02:59 +01:00
Guillaume B
e89cfd5ce6 Example text update 2020-02-25 11:40:49 +01:00
Guillaume B
c11ce51abd minor refactoring 2020-02-25 11:40:16 +01:00
Guillaume B
384ea30612 Creation of QaFeatures initial commit 2020-02-25 11:27:59 +01:00
Guillaume B
1a7da783a9 Created QaExample and parsing from question and context pair 2020-02-24 16:24:43 +01:00
Guillaume B
ed82d934e6 Created QaExample and parsing from question and context pair 2020-02-24 16:23:44 +01:00
Guillaume B
a748a2bdc4 Added test for NER and example for sentiment 2020-02-24 14:27:23 +01:00
Guillaume B
6a3bfee4a3 Added pre-trained NER model to pipelines 2020-02-24 14:19:14 +01:00
Guillaume B
448638c338 Updated tokenizer dependency 2020-02-21 21:38:09 +01:00
Guillaume B
78cacdaf2e Added integration test for RoBERTa MaskedLM 2020-02-19 20:55:50 +01:00
Guillaume B
ee64db897e Initial commit for RoBERTa 2020-02-19 20:52:27 +01:00
Guillaume B
a449684f49 Completed BertForMaskedLM and added integration test 2020-02-17 21:44:12 +01:00
Guillaume B
f3d4736c13 Attention mask tested & validated 2020-02-17 19:11:01 +01:00
Guillaume B
765d2c88de BertModel implemented (incl. loading weights) 2020-02-17 19:02:47 +01:00
Guillaume B
8526a6b9bc Added BertSelfAttention 2020-02-16 17:19:12 +01:00
Guillaume B
20ec99e159 Added BertEmbeddings 2020-02-16 15:16:54 +01:00
Guillaume B
85d17e2736 Initial commit for BERT implementation 2020-02-16 14:29:35 +01:00
Guillaume B
a7264ff0f2 Updated tokenization dependency (no longer requires rust nightly) 2020-02-15 11:37:50 +01:00
Guillaume B
d6716a921d Addition of masked LM for DistilBERT (incl. example) 2020-02-13 22:19:03 +01:00