guillaume-be/rust-bert
1
1
Fork 0
mirror of https://github.com/guillaume-be/rust-bert.git synced 2024-08-16 16:10:25 +03:00
Code Issues Packages Projects Releases Wiki Activity
1,109 Commits 5 Branches 0 Tags 5.8 MiB
main
Commit Graph

266 Commits

Author SHA1 Message Date
Guillaume B
95d3bf5a53 Updated generation for XLNet 2020-09-19 17:31:56 +02:00
Guillaume B
536b0b02db updated relative shift 2020-09-18 17:41:28 +02:00
Guillaume B
7db7b2b34c updated weights shape 2020-09-18 17:12:07 +02:00
Guillaume B
abe177c1c6 XLNetModel forward pass implemented 2020-09-18 16:41:29 +02:00
Guillaume B
6f907ff995 Merge branch 'master' of https://github.com/guillaume-be/rust-bert into xlnet_implementation 2020-09-16 17:19:22 +02:00
Guillaume B
b9e221f322 Merge branch 'master' into xlnet_implementation 2020-09-16 17:17:00 +02:00
Guillaume B
93277439e5 Updated documentation and RoBERTa model ouputs 2020-09-15 17:45:39 +02:00
guillaume-be
59e6cb54f0 updated ALBERT documentation 2020-09-14 18:33:58 +02:00
Guillaume B
47d9a1017d Updated T5 (clippy) 2020-09-13 12:25:22 +02:00
Guillaume B
6cef45787d Updated generation (clippy) 2020-09-13 11:08:49 +02:00
Guillaume B
5aa1e635ba Updated BERT and DistilBERT (clippy) 2020-09-12 17:12:49 +02:00
Guillaume B
7e9d6d7e39 Updated Bart & Marian (clippy warnings) 2020-09-12 16:17:58 +02:00
Guillaume B
daa6dba2d2 Updated Albert (clippy warnings) 2020-09-12 15:11:56 +02:00
Evan Pete Walsh
34e061c0de
add cached-path file utils (#74) 
* add cached-path

* updates

* fix typo, add deprecation notice

* fix up

* update cached-path dependency

* update cached-path

* remove usage of 'download_resource' in examples

* clean up
 2020-09-12 13:47:23 +02:00
Guillaume B
64320b55c8 Initial commit for XLNetRelativeAttention 2020-09-10 18:10:54 +02:00
Guillaume B
eabab31aa3 Definition of XLNet configuration 2020-09-08 16:47:45 +02:00
Guillaume B
6e9a0310e3 Updated examples and tests for zero shot classification 
Multilabel example for zero-shot classification
 2020-09-06 10:39:18 +02:00
Guillaume B
080efc6791 Formatting update 2020-09-06 10:28:32 +02:00
Guillaume B
5a833c7caa Moved csv to dev dependencies 2020-09-06 10:27:29 +02:00
Guillaume B
b52b0cb005 Addition of integration tests for zero-shot classification 2020-09-05 15:02:34 +02:00
Guillaume B
56747f7033 reversed error handling for pipelines to maintain backward compatibility 2020-09-01 18:00:38 +02:00
Guillaume B
71121e56d8 Addition of BART as an option for sequence classification pipelines, updated return type of pipelines to be a Result 2020-09-01 17:52:49 +02:00
Guillaume B
c6886096d2 Updated summarization output resulting from tokenization updates 2020-08-30 10:18:38 +02:00
Guillaume B
50ee1a1e4e Updated for additional tokenizer settings & configuration validity check 2020-08-30 09:35:38 +02:00
Guillaume B
3200026c0b Updated to make prefix space optional for models using Roberta tokenizer 2020-08-29 15:58:03 +02:00
guillaume-be
325f97b676 Improved error handling 2020-08-22 12:00:02 +02:00
Sacha Arbonel
9205df49b4
replace failure with anyhow (#69) 
* replace failure with anyhow

* formatting update with `fmt`

Co-authored-by: guillaume-be <guillaume.becquin@gmail.com>
 2020-08-12 13:39:04 +02:00
Guillaume B
5b00074ab5 Addition of integration test for XLMRoberta for NER (German) 2020-07-23 19:34:52 +02:00
Guillaume B
c9262a310a Addition of integration tests for BERT and RoBERTa QA 2020-07-12 09:49:22 +02:00
Guillaume B
ec54a213ad Addition of Albert to pipeline options 2020-07-12 09:35:06 +02:00
Guillaume B
e6938e1dcb Addition of BERT option for QA 2020-07-08 21:59:31 +02:00
Guillaume B
154fe2a4d0 Added integration tests for T5 and dependencies download 2020-07-07 19:29:45 +02:00
Guillaume B
1e865ef6eb Addition of T5_BASE dependency and download script 2020-07-07 18:15:15 +02:00
Guillaume B
a6b11d5449 Implementation of generation for T5 2020-07-07 18:07:31 +02:00
Guillaume B
7938abc76d Implementation of T5ForConditionalGeneration 2020-07-06 17:43:27 +02:00
Guillaume B
857b4bf7a5 Updated T5 attention, base model output validated w/o cache 2020-07-05 17:49:27 +02:00
Guillaume B
fde80e4470 Updated T5 model, weights loading 2020-07-05 12:27:26 +02:00
Guillaume B
8e7696ff27 T5 dependencies download and configuration setup 2020-06-30 19:11:40 +02:00
Guillaume B
23310dfc1e Added documentation, updated tests & doctests 2020-06-28 11:04:36 +02:00
Guillaume B
68def5a912 Addition of tests for conversation 2020-06-28 09:31:41 +02:00
Guillaume B
caa2ba9108 Updated conversation manager and example 2020-06-28 09:09:34 +02:00
Guillaume B
dbdc75a9bb Fixed generation bug, enable multiple batched conversations 2020-06-27 18:44:14 +02:00
Guillaume B
372c357463 Update of conversation manager and conversations 2020-06-27 18:27:43 +02:00
Guillaume B
c946791b58 Initial draft for conversation and conversation manager 2020-06-27 10:51:59 +02:00
Guillaume B
f9895752bd Addition of history tokens for multi-turn conversation 2020-06-27 09:32:28 +02:00
Guillaume B
c045b3212f Updated generation process to allow for direct ids input 2020-06-25 21:32:45 +02:00
Guillaume B
9081bc3318 Initial single turn conversation 2020-06-25 19:32:36 +02:00
Guillaume B
47e36c4e8c Code formatted using rustfmt 2020-06-23 16:54:46 +02:00
Guillaume B
b5b6f68410 addition of albert dependencies download 2020-06-22 20:59:36 +02:00
Guillaume B
d49a1e0935 Updated documentation, addition of weights download for ALBERT 2020-06-22 20:51:01 +02:00
Guillaume B
12a1e0258c Addition of integration tests for Albert 2020-06-22 18:54:51 +02:00
Guillaume B
2897027ab0 Addition of AlbertForQuestionAnswering and AlbertForMultipleChoices 2020-06-22 18:29:16 +02:00
Guillaume B
8b2fda9f54 Addition of AlbertForMaskedLM 2020-06-21 11:50:15 +02:00
Guillaume B
d3e91204ae Addition of AlbertMLMHead 2020-06-21 10:50:58 +02:00
Guillaume B
f4afd35ed6 albert config implementation, download scripts 2020-06-16 19:07:37 +02:00
Guillaume B
bd2906fcfc Examples clean-up 2020-06-06 10:37:53 +02:00
Guillaume B
db3d126a2b non optional LayerState fields 2020-06-05 20:49:26 +02:00
Guillaume B
e0772f42ae Updated version 2020-06-05 09:45:12 +02:00
Guillaume B
40a6a148a0 Migration of translation pipeline to be non mutable 2020-06-04 23:05:35 +02:00
Guillaume B
3781040055 Migration of BART to non mutable generator (2) 2020-06-04 22:12:11 +02:00
Guillaume B
69e7000aeb Definition of Cache enum and implementation for GPT2 2020-06-04 13:00:10 +02:00
Guillaume B
3c010a077b Updated generation code for GPT and GPT2 to allow non mutable models 2020-06-03 19:08:40 +02:00
Guillaume B
829965d68b Model resources update, documentation 2020-05-25 22:01:53 +02:00
Guillaume B
ff0277925e Creation of translation pipeline, added documentation, created unit tests 2020-05-25 16:20:23 +02:00
Guillaume B
67ab4fc772 Updated copyright notices 2020-05-24 21:20:21 +02:00
Guillaume B
d6b5abe947 Split MarianForConditionalGeneration to own module 2020-05-24 20:15:07 +02:00
Guillaume B
cccad54194 Updates to BART for Marian compatibility 2020-05-24 17:00:04 +02:00
Guillaume B
d0fc3ff40d Addition of multi-label classification prediction method for sequence classification pipeline 
Version update
 2020-05-20 17:51:29 +02:00
Guillaume B
0bbb47d1db Added options for label consolidation for sub tokens 2020-05-11 16:40:25 +02:00
Guillaume B
6d61074f7f Updated consolidation and documentation 2020-05-10 12:27:42 +02:00
Guillaume B
1a9e315edf Added sub-token consolidation 2020-05-10 12:05:13 +02:00
Guillaume B
9d3a944051 Updated token classification pipeline to use next tokenization features, reference to original text 2020-05-10 11:38:28 +02:00
Guillaume B
053413fcbc Addition of generic classification model (following generic token classification pattern) 2020-05-07 17:26:20 +02:00
Guillaume B
83e43ffcd5 Updated resource list 2020-05-03 14:59:13 +02:00
Guillaume B
c6f5cdd859 Updated documentation 2020-05-03 13:37:18 +02:00
Guillaume B
029d4bd47c Addition of Electra resources 2020-05-03 10:05:32 +02:00
Guillaume B
5a1c1ae7a0 Addition of ElectraDiscriminator 2020-05-03 09:46:59 +02:00
Guillaume B
2c25dc1650 Addition of ElectraForTokenClassification 2020-05-01 10:00:47 +02:00
Guillaume B
4334fa1758 Addition of ElectraForMaskedLM 2020-05-01 08:47:52 +02:00
Guillaume B
5bec2548c1 Addition of Electra generator and discriminator heads 2020-04-29 18:59:37 +02:00
Guillaume B
45eeb7ae5b ElectraModel implementation, weights loaded, forward pass 2020-04-29 18:30:36 +02:00
Guillaume B
b2308d741d Addition of Electra Config and Embeddings 2020-04-28 18:51:04 +02:00
Guillaume B
194a447b06 Updated documentation 2020-04-26 11:49:40 +02:00
Guillaume B
cb254995fd Addition of dependencies download example 2020-04-26 10:51:29 +02:00
Guillaume B
0a85d5ba21 Updated NER Pipeline 2020-04-26 09:13:13 +02:00
Guillaume B
2aeace4a6e Updated Question Answering Pipeline 2020-04-26 09:08:04 +02:00
Guillaume B
69b819ce5e Updated Summarization and Sentiment pipelines 2020-04-26 08:57:20 +02:00
Guillaume B
c65943ab2f Updated model weight download 2020-04-24 17:04:28 +02:00
Guillaume B
5f0a36c1f9 Merge remote-tracking branch 'remotes/origin/master' into benchmarks_generation 
# Conflicts:
#	examples/summarization.rs
 2020-04-06 20:29:32 +02:00
Guillaume B
2d7f4c6743 updated summarization example 2020-04-06 15:36:12 +02:00
Guillaume B
35fcd0b6a3 updated summarization example 2020-04-06 14:45:52 +02:00
Guillaume B
793118bc94 - reset cache for BART model 
- sentiment classifier optimization
- question answering pipeline optimization
 2020-04-06 13:26:50 +02:00
Guillaume B
dc727e0baa Updated documentation 2020-04-05 11:40:08 +02:00
Guillaume B
6c7353de6e Addition of summarization pipeline and integration tests 2020-04-05 10:21:45 +02:00
Guillaume B
0a8832a012 End-to-end summarization 2020-04-04 17:11:37 +02:00
Guillaume B
fa87fce96e Summarization without beam search 2020-04-04 10:31:18 +02:00
Guillaume B
dbf6841610 Optimization of generation pipeline 2020-04-04 09:40:13 +02:00
Guillaume B
6aa6a4b2a2 Encoder input for summarization validated 2020-04-03 17:11:09 +02:00
Guillaume B
b8fe6a41e5 Updated language generation API to work with mutable models 2020-04-03 14:48:08 +02:00
Guillaume B
55db579baa ConditionalGeneration and SequenceClassification implemented 2020-04-02 16:16:05 +02:00
Guillaume B
fe529b2fec BartModel forward pass validated 2020-04-02 14:48:28 +02:00
Guillaume B
642874b22b BartModel implemented and weights loaded 2020-04-02 11:16:50 +02:00
Guillaume B
44a83ad4ab initial draft for cached attention 2020-03-29 19:31:12 +02:00
Guillaume B
efd2ed0509 BART config & initial input preparation 2020-03-29 12:01:13 +02:00
Guillaume B
eea1667f26 Added documentation for pipelines 2020-03-27 16:17:17 +01:00
Guillaume B
496f7ba0bb Completed documentation for DistilBERT 2020-03-24 19:59:00 +01:00
Guillaume B
6c6e5526ec Completed documentation for BERT 2020-03-22 15:39:22 +01:00
Guillaume B
e1f3b743da BERT documentation (ongoing) 2020-03-22 11:56:58 +01:00
Guillaume B
54b10c54a7 Updated lib structure and visibility 2020-03-22 09:54:49 +01:00
Guillaume B
f17b0d7da8 Lib clean-up and doc landing page 2020-03-21 16:53:15 +01:00
Guillaume B
24335a5883 Lib clean-up (default binary deleted, re-exports removed) 2020-03-21 11:35:41 +01:00
Guillaume B
56bf0f7691 Improved error message for examples 2020-03-19 18:28:56 +01:00
Guillaume B
344e27c927 Performance optimization for language generation 2020-03-17 20:06:45 +01:00
Guillaume B
64a01e3f73 End-to-end generation completed, updated README, bumped version 2020-03-16 16:17:23 +01:00
Guillaume B
5539e9360a Beam population loop 2020-03-16 12:38:49 +01:00
Guillaume B
2dbdb2c2be beam search preparation 2020-03-16 09:46:17 +01:00
Guillaume B
2621e0dc5d Added tests for GPT2 and OpenAI GPT generation 2020-03-15 21:09:46 +01:00
Guillaume B
e572cdb61a End to end generation without beam search 2020-03-15 20:54:21 +01:00
Guillaume B
6e61a54a0f Update of input ids, stop if eos_id and update attention mask 2020-03-15 20:04:36 +01:00
Guillaume B
c2ff52c217 Addition of top_k top_p sampling 2020-03-12 22:30:31 +01:00
Guillaume B
b6e186b7b0 Initial implementation of banned tokens detection 2020-03-12 18:49:45 +01:00
Guillaume B
61721ee2b8 Updated generation based on latest Transformers update (preparation) 2020-03-11 19:31:53 +01:00
Guillaume B
de86e57ee9 Updated generation based on latest Transformers update 2020-03-11 19:17:53 +01:00
Guillaume B
dd3415bbc1 Added repetition penalty 2020-03-10 20:58:18 +01:00
Guillaume B
c7727b0b97 Model forward pass for generation & GPT2 fix 2020-03-10 18:50:22 +01:00
Guillaume B
8f044b5bcc Updated generation preparation 2020-03-09 20:35:29 +01:00
Guillaume B
2d63fc3d18 Added tests for GPT2 2020-03-08 17:55:47 +01:00
Guillaume B
c98b689297 GPT2 download 2020-03-08 17:50:57 +01:00
Guillaume B
1923af0ac7 initial structure for generation 2020-03-08 17:08:18 +01:00
Guillaume B
596e0efc0e Added error message for SQuAD dataset environment variable 2020-03-07 15:49:09 +01:00
Guillaume B
123d90c40d Updated SQuAD example 2020-03-07 15:46:27 +01:00
Guillaume B
996fdb159f Updated QA for improved batching 2020-03-07 15:21:02 +01:00
Guillaume B
20bd0108c3 addition of SQuAD processor 2020-03-07 11:23:05 +01:00
Guillaume B
999f6e52aa initial commit for batch processing of QA inputs 2020-03-06 21:40:32 +01:00
Guillaume B
89b486fb12 Added integration test for OpenAI GPT 2020-03-01 11:29:57 +01:00
Guillaume B
d820ea8eea End-to-end OpenAI GPT model implemented 2020-03-01 11:26:34 +01:00
Guillaume B
ad1dbfcbc2 Initial commit for GPT model 2020-03-01 10:59:48 +01:00
Guillaume B
7a9cf64c20 Completed GPT2 example and integration test 2020-02-29 16:07:47 +01:00
Guillaume B
d038626d37 Updated GPT2 implementation, validated 2020-02-29 14:13:08 +01:00
Guillaume B
a276e65cf4 GPT2 Model implemented 2020-02-29 11:39:19 +01:00
Guillaume B
c12c0c479e Calculation of GPT2 embeddings 2020-02-29 10:56:56 +01:00
Guillaume B
811b0ad483 Implementation of Transformer Block 2020-02-28 21:09:42 +01:00
Guillaume B
e15dfe127d Implementation of Attention 2020-02-28 20:28:33 +01:00
Guillaume B
b0e84fc2b9 initial commit for GPT2 2020-02-27 18:55:17 +01:00
Guillaume B
aa819284df updated license headers 2020-02-25 18:39:08 +01:00
Guillaume B
fe4f7c689d Updated README, bumped version 2020-02-25 18:37:02 +01:00
Guillaume B
afa606152b End to end question answering pipeline implemented 2020-02-25 18:32:26 +01:00
Guillaume B
ae11677e2d Updated position embeddings, features stacking and sinusoidal embeddings config overwrite 2020-02-25 16:02:59 +01:00
Guillaume B
e89cfd5ce6 Example text update 2020-02-25 11:40:49 +01:00
Guillaume B
c11ce51abd minor refactoring 2020-02-25 11:40:16 +01:00