mirror of
https://github.com/guillaume-be/rust-bert.git
synced 2024-08-16 16:10:25 +03:00
* stop word tokenizer implementation * - Addition of all-mini-lm-l6-v2 * initial implementation of keyword scorer * Cosine Similarity keyword extraction * Added lower case parsing from tokenizer config for sentence embeddings * Initial draft of pipeline complete * Addition of Maximal Marginal relevance scorer * Addition of Max Sum scorer * Lowercase and ngrams handling * Improved n-gram handling * Skip n-grams containing stopwords * Fixed short sentence input and added documentation * Updated documentation and defaults, added example * Addition of tests for keywords extractions * Updated changelog * Fixed Clippy warnings |
||
---|---|---|
.. | ||
async-sentiment.rs | ||
conversation.rs | ||
generation_gpt2.rs | ||
generation_gpt_neo.rs | ||
generation_reformer.rs | ||
generation_xlnet.rs | ||
keyword_extraction.rs | ||
masked_language_model_bert.rs | ||
named_entities_recognition.rs | ||
natural_language_inference_deberta.rs | ||
part_of_speech_tagging.rs | ||
question_answering_bert.rs | ||
question_answering_longformer.rs | ||
question_answering_squad.rs | ||
question_answering.rs | ||
sentence_embeddings_local.rs | ||
sentence_embeddings.rs | ||
sentiment_analysis_fnet.rs | ||
sentiment_analysis_sst2.rs | ||
sentiment_analysis.rs | ||
sequence_classification_multilabel.rs | ||
sequence_classification.rs | ||
summarization_bart.rs | ||
summarization_pegasus.rs | ||
summarization_prophetnet.rs | ||
summarization_t5.rs | ||
token_classification.rs | ||
translation_builder.rs | ||
translation_m2m100.rs | ||
translation_marian.rs | ||
translation_mbart.rs | ||
translation_t5.rs | ||
zero_shot_classification.rs |