John Snow Labs Spark-NLP 3.4.2: DeBERTa embeddings, new caching in Word2Vec and Doc2Vec, new state-of-the-art models, and bug fixes!

[maziyarpanahi]

---

Overview

We are pleased to release Spark NLP 🚀 3.4.2! This release comes with a new DeBERTa transformer for word embeddings, new caching to speed up training Word2Vec and Doc2Vec, new English and multi-lingual state-of-the-art models, and bug fixes!

As always, we would like to thank our community for their feedback, questions, and feature requests.

---

New Features

• Introducing DeBertaEmbeddings annotator. DeBERTa (Decoding-enhanced BERT with disentangled attention) improves the BERT and RoBERTa models using two novel techniques. Compared to RoBERTa-Large, a DeBERTa model trained on half of the training data performs consistently better on a wide range of NLP tasks, achieving improvements on MNLI by +0.9% (90.2% vs. 91.1%), on SQuAD v2.0 by +2.3% (88.4% vs. 90.7%) and RACE by +3.6% (83.2% vs. 86.8%). This annotator is compatible with all the models trained/fine-tuned by using DebertaV2Model for PyTorch or TFDebertaV2Model for TensorFlow models (DeBERTa-v2 & DeBERTa-v3) in HuggingFace
• Introducing a new param enableCaching in Doc2VecApproach to speed up the training
• Introducing a new param enableCaching in Word2VecApproach to speed up the training
• Support Databricks runtime 10.3, 10.3 ML, and 10.3 ML & GPU
• Support EMR emr-5.34.0 and emr-6.5.0

---

Bug Fixes

• Fix bestModelMetric param when the set value was ignored Make sure bestModelMetric is being used #6978

New Notebooks

Import DeBERTa models to Spark NLP 🚀

Spark NLP	HuggingFace Notebooks	Colab
DeBertaEmbeddings	HuggingFace in Spark NLP - DeBERTa

You can visit Import Transformers in Spark NLP for more info

---

Models

New state-of-the-art DeBERTa models:

Model	Name	Lang
DeBertaEmbeddings	deberta_v3_xsmall	en
DeBertaEmbeddings	deberta_v3_small	en
DeBertaEmbeddings	deberta_v3_basel	en
DeBertaEmbeddings	deberta_v3_large	en
DeBertaEmbeddings	mdeberta_v3_base	xx

---

Documentation

• TF Hub & HuggingFace to Spark NLP
• Models Hub with new models
• Spark NLP documentation
• Spark NLP Scala APIs
• Spark NLP Python APIs
• Spark NLP Workshop notebooks
• Spark NLP publications
• Spark NLP in Action
• Spark NLP training certification notebooks for Google Colab and Databricks
• Spark NLP Display for visualization of different types of annotations
• Discussions Engage with other community members, share ideas, and show off how you use Spark NLP!

---

Installation

Python

#PyPI

pip install spark-nlp==3.4.2

Spark Packages

spark-nlp on Apache Spark 3.0.x and 3.1.x (Scala 2.12 only):

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp_2.12:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp_2.12:3.4.2

GPU

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-gpu_2.12:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-gpu_2.12:3.4.2

spark-nlp on Apache Spark 3.2.x (Scala 2.12 only):

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-spark32_2.12:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-spark32_2.12:3.4.2

GPU

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-gpu-spark32_2.12:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-gpu-spark32_2.12:3.4.2

spark-nlp on Apache Spark 2.4.x (Scala 2.11 only):

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-spark24_2.11:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-spark24_2.11:3.4.2

GPU

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-gpu-spark24_2.11:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-gpu-spark24_2.11:3.4.2

spark-nlp on Apache Spark 2.3.x (Scala 2.11 only):

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-spark23_2.11:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-spark23_2.11:3.4.2

GPU

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-spark23-gpu_2.11:3.4.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-gpu-spark23_2.11:3.4.2

Maven

spark-nlp on Apache Spark 3.0.x and 3.1.x:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp_2.12</artifactId>
    <version>3.4.2</version>
</dependency>

spark-nlp-gpu:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-gpu_2.12</artifactId>
    <version>3.4.2</version>
</dependency>

spark-nlp on Apache Spark 3.2.x:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-spark32_2.12</artifactId>
    <version>3.4.2</version>
</dependency>

spark-nlp-gpu:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-gpu-spark32_2.12</artifactId>
    <version>3.4.2</version>
</dependency>

spark-nlp on Apache Spark 2.4.x:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-spark24_2.11</artifactId>
    <version>3.4.2</version>
</dependency>

spark-nlp-gpu:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-gpu-spark24_2.11</artifactId>
    <version>3.4.2</version>
</dependency>

spark-nlp on Apache Spark 2.3.x:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-spark23_2.11</artifactId>
    <version>3.4.2</version>
</dependency>

spark-nlp-gpu:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-gpu-spark23_2.11</artifactId>
    <version>3.4.2</version>
</dependency>

FAT JARs

• CPU on Apache Spark 3.0.x/3.1.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-assembly-3.4.2.jar

• GPU on Apache Spark 3.0.x/3.1.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-gpu-assembly-3.4.2.jar

• CPU on Apache Spark 3.2.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-spark32-assembly-3.4.2.jar

• GPU on Apache Spark 3.2.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-gpu-spark32-assembly-3.4.2.jar

• CPU on Apache Spark 2.4.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-spark24-assembly-3.4.2.jar

• GPU on Apache Spark 2.4.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-gpu-spark24-assembly-3.4.2.jar

• CPU on Apache Spark 2.3.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-spark23-assembly-3.4.2.jar

• GPU on Apache Spark 2.3.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-gpu-spark23-assembly-3.4.2.jar

What's Changed

• 2022-01-11-sbiobertresolve_snomed_findings_aux_concepts_en by @jsl-models in 2022-01-11-sbiobertresolve_snomed_findings_aux_concepts_en #6751
• 2022-01-17-sbertresolve_ner_model_finder_en by @jsl-models in 2022-01-17-sbertresolve_ner_model_finder_en #6776
• 2022-01-17-sbiobertresolve_clinical_abbreviation_acronym_en by @jsl-models in 2022-01-17-sbiobertresolve_clinical_abbreviation_acronym_en #6777
• 2022-01-17-ner_deid_subentity_roberta_es by @jsl-models in 2022-01-17-ner_deid_subentity_roberta_es #6778
• 2022-01-17-ner_deid_generic_roberta_es by @jsl-models in 2022-01-17-ner_deid_generic_roberta_es #6779
• 2022-01-18-ner_profiling_clinical_en by @jsl-models in 2022-01-18-ner_profiling_clinical_en #6780
• 2022-01-18-sbiobertresolve_icd10cm_augmented_en by @jsl-models in 2022-01-18-sbiobertresolve_icd10cm_augmented_en #6787
• 2022-01-18-ner_deid_generic_es by @jsl-models in 2022-01-18-ner_deid_generic_es #6786
• 2022-01-18-ner_deid_subentity_es by @jsl-models in 2022-01-18-ner_deid_subentity_es #6785
• 2022-01-18-sbiobertresolve_loinc_augmented_en by @jsl-models in 2022-01-18-sbiobertresolve_loinc_augmented_en #6788
• 2022-01-18-sbluebertresolve_loinc_uncased_en by @jsl-models in 2022-01-18-sbluebertresolve_loinc_uncased_en #6791
• 2022-01-18-sbiobertresolve_snomed_drug_en by @jsl-models in 2022-01-18-sbiobertresolve_snomed_drug_en #6790
• 2022-01-18-sbiobertresolve_mesh_en by @jsl-models in 2022-01-18-sbiobertresolve_mesh_en #6789
• 2022-01-18-ner_profiling_biobert_en by @jsl-models in 2022-01-18-ner_profiling_biobert_en #6792
• 2022-01-21-ner_model_finder_en by @jsl-models in 2022-01-21-ner_model_finder_en #6804
• 2022-01-21-ner_profiling_biobert_en by @jsl-models in 2022-01-21-ner_profiling_biobert_en #6802
• 2022-01-21-sbiobertresolve_icd10cm_augmented_en by @jsl-models in 2022-01-21-sbiobertresolve_icd10cm_augmented_en #6803
• 2022-01-24-deid_pipeline_es by @jsl-models in 2022-01-24-deid_pipeline_es #6810
• 2022-02-01-ner_supplement_clinical_en by @jsl-models in 2022-02-01-ner_supplement_clinical_en #6838
• 2022-02-01-sbiobertresolve_clinical_abbreviation_acronym_en by @jsl-models in 2022-02-01-sbiobertresolve_clinical_abbreviation_acronym_en #6839
• 2022-02-07-bert_sequence_classifier_pico_biobert_en by @jsl-models in 2022-02-07-bert_sequence_classifier_pico_biobert_en #6874
• 2022-02-08-bert_sequence_classifier_gender_biobert_en by @jsl-models in 2022-02-08-bert_sequence_classifier_gender_biobert_en #6876
• 2022-02-08-bert_sequence_classifier_ade_en by @jsl-models in 2022-02-08-bert_sequence_classifier_ade_en #6879
• 2022-02-08-distilbert_sequence_classifier_ade_en by @jsl-models in 2022-02-08-distilbert_sequence_classifier_ade_en #6883
• 2022-02-09-bert_token_classifier_ner_supplement_en by @jsl-models in 2022-02-09-bert_token_classifier_ner_supplement_en #6885
• 2022-02-08-ner_nature_nero_clinical_en by @jsl-models in 2022-02-08-ner_nature_nero_clinical_en #6884
• Models hub internal merge to master for 3.4.1 HC by @josejuanmartinez in Models hub internal merge to master for 3.4.1 HC #6886
• Deleted duplicate model. by @gadde5300 in Deleted duplicate model. #6887
• 2022-02-09-classifierdl_bert_news_pipeline_ur by @jsl-models in 2022-02-09-classifierdl_bert_news_pipeline_ur #6888
• 2022-02-09-classifierdl_distilbert_sentiment_vi by @jsl-models in 2022-02-09-classifierdl_distilbert_sentiment_vi #6890
• 2022-02-09-sbiobertresolve_rxnorm_augmented_re_en by @jsl-models in 2022-02-09-sbiobertresolve_rxnorm_augmented_re_en #6889
• RxNorm addition to 3.4.1 HC Release by @josejuanmartinez in RxNorm addition to 3.4.1 HC Release #6894
• Updated metrics by @gadde5300 in Updated metrics #6893
• Update licensed_release_notes.md by @muhammetsnts in Update licensed_release_notes.md #6895
• [skip ci] Create PR 3.4.1-healthcare-docs-028d310242dd267db1bf5358da36d2cb06564fa2-2 by @jsl-builder in [skip ci] Create PR 3.4.1-healthcare-docs-028d310242dd267db1bf5358da36d2cb06564fa2-2 #6891
• Adds missing entities for albert models by @josejuanmartinez in Adds missing entities for albert models #6892
• Fix Longformer missing entities by @josejuanmartinez in Fix Longformer missing entities #6897
• update python documentation 3.4.1 by @xusliebana in update python documentation 3.4.1 #6896
• Update licensed_version_compatibility.md by @muhammetsnts in Update licensed_version_compatibility.md #6898
• 2022-02-10-xlm_roberta_large_token_classifier_masakhaner_pipeline_xx by @jsl-models in 2022-02-10-xlm_roberta_large_token_classifier_masakhaner_pipeline_xx #6901
• NMH-58: Simple analyzer for model name [skip-test] by @KshitizGIT in NMH-58: Simple analyzer for model name [skip-test] #6900
• Update documentation about the models by @Damla-Gurbaz in Update documentation about the models  #6903
• Update documentation about the models by @Damla-Gurbaz in Update documentation about the models #6911
• Add new demos by @agsfer in Add new demos #6912
• Update licensed_release_notes.md by @muhammetsnts in Update licensed_release_notes.md #6913
• 2022-02-12-distilbert_base_sequence_classifier_qqp_en by @jsl-models in 2022-02-12-distilbert_base_sequence_classifier_qqp_en #6915
• Create CODE_OF_CONDUCT.md by @maziyarpanahi in Create CODE_OF_CONDUCT.md #6916
• fixed model editions on md files by @luca-martial in fixed model editions on md files #6914
• Fixes typos in English clinical_deidentification with STREET entity by @Damla-Gurbaz in Fixes typos in English clinical_deidentification with STREET entity #6922
• 2022-02-14-distilbert_base_sequence_classifier_food_en by @jsl-models in 2022-02-14-distilbert_base_sequence_classifier_food_en #6923
• 2022-02-15-bert_token_classifier_scandi_ner_pipeline_xx by @jsl-models in 2022-02-15-bert_token_classifier_scandi_ner_pipeline_xx #6933
• Doc/alab update ss by @rpranab in Doc/alab update ss #6840
• added additional details by @albertoandreottiATgmail in added additional details #6941
• Copy demos by @agsfer in Copy demos #6943
• 2022-02-16-distilbert_base_sequence_classifier_toxicity_de by @jsl-models in 2022-02-16-distilbert_base_sequence_classifier_toxicity_de #6945
• Adds Synapse and FastAPI+LP to Productionizing Spark NLP web page by @agsfer in Adds Synapse and FastAPI+LP to Productionizing Spark NLP web page #6947
• Changes bad name/path until new version is merged by @josejuanmartinez in Changes bad name/path until new version is merged #6946
• updated for md files (added benchmark) by @Damla-Gurbaz in updated for md files (added benchmark) #6949
• Bump follow-redirects from 1.14.7 to 1.14.8 in /docs/_frontend by @dependabot in Bump follow-redirects from 1.14.7 to 1.14.8 in /docs/_frontend #6929
• 2022-02-08-Ner_conll2003_100d_en by @jsl-models in 2022-02-08-Ner_conll2003_100d_en #6878
• 2022-02-20-Ner_glove_100d_en by @jsl-models in 2022-02-20-Ner_glove_100d_en #6954
• 2022-02-18-distilbert_base_sequence_classifier_airlines_en by @jsl-models in 2022-02-18-distilbert_base_sequence_classifier_airlines_en #6950
• 2022-02-21-bert_biomed_pubmed_uncased_en by @jsl-models in 2022-02-21-bert_biomed_pubmed_uncased_en #6955
• 2022-02-22-bert_sequence_classifier_hatexplain_pipeline_en by @jsl-models in 2022-02-22-bert_sequence_classifier_hatexplain_pipeline_en #6958
• 2022-02-22-bert_sequence_classifier_antisemitism_pipeline_en by @jsl-models in 2022-02-22-bert_sequence_classifier_antisemitism_pipeline_en #6957
• 2022-02-23-bert_sequence_classifier_trec_coarse_pipeline_en by @jsl-models in 2022-02-23-bert_sequence_classifier_trec_coarse_pipeline_en #6960
• 2022-02-23-bert_sequence_classifier_age_news_pipeline_en by @jsl-models in 2022-02-23-bert_sequence_classifier_age_news_pipeline_en #6961
• "Serving Spark NLP via API" documentation by @agsfer in "Serving Spark NLP via API" documentation #6951
• Fixes API articles format problems by @josejuanmartinez in Fixes API articles format problems #6967
• Fixes API articles format problems by @josejuanmartinez in Fixes API articles format problems #6968
• Feature NMH-65: Collect and use statistics on downloads of model by @mahmoodbayeshi in Feature NMH-65: Collect and use statistics on downloads of model #6835
• Updated md files by @bunyamin-polat in Updated md files #6969
• Distributes API articles between Spark NLP and Spark NLP for Healthcare by @josejuanmartinez in Distributes API articles between Spark NLP and Spark NLP for Healthcare #6985
• Added documentation for 3.11.0 release by @kolia1985 in Added documentation for 3.11.0 release #6846
• fix in date by @albertoandreottiATgmail in fix in date #6987
• Add new demos by @agsfer in Add new demos #6986
• missing stuff by @albertoandreottiATgmail in missing stuff #6996
• Make sure bestModelMetric is being used by @maziyarpanahi in Make sure bestModelMetric is being used #6978
• Introducing enableCaching param in Doc2Vec and Word2Vec trainable annotators by @maziyarpanahi in Introducing enableCaching param in Doc2Vec and Word2Vec trainable annotators #6988
• 2022-03-03-lemma_spacylookup_sr_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_sr_3_0 #7010
• 2022-03-03-lemma_spacylookup_da_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_da_3_0 #7011
• 2022-03-03-lemma_spacylookup_hu_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_hu_3_0 #7012
• 2022-03-03-lemma_spacylookup_id_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_id_3_0 #7013
• 2022-03-03-lemma_spacylookup_it_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_it_3_0 #7014
• 2022-03-03-lemma_spacylookup_sv_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_sv_3_0 #7015
• 2022-03-03-lemma_spacylookup_de_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_de_3_0 #7016
• 2022-03-03-lemma_spacylookup_ro_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_ro_3_0 #7017
• 2022-03-03-lemma_spacylookup_ur_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_ur_3_0 #7018
• 2022-03-03-lemma_spacylookup_ru_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_ru_3_0 #7019
• 2022-03-03-lemma_spacylookup_tr_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_tr_3_0 #7020
• 2022-03-03-lemma_spacylookup_cs_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_cs_3_0 #7021
• 2022-03-03-lemma_spacylookup_lb_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_lb_3_0 #7022
• 2022-03-03-lemma_spacylookup_hr_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_hr_3_0 #7023
• 2022-03-03-lemma_spacylookup_nl_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_nl_3_0 #7024
• 2022-03-03-lemma_spacylookup_fr_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_fr_3_0 #7025
• 2022-03-03-lemma_spacylookup_es_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_es_3_0 #7026
• 2022-03-03-lemma_spacylookup_mk_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_mk_3_0 #7027
• 2022-03-03-lemma_spacylookup_tl_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_tl_3_0 #7028
• 2022-03-03-lemma_spacylookup_lt_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_lt_3_0 #7029
• 2022-03-03-lemma_spacylookup_ca_3_0 by @jsl-models in 2022-03-03-lemma_spacylookup_ca_3_0 #7030
• Introducing DeBERTa annotator by @maziyarpanahi in Introducing DeBERTa annotator #7042
• Updated lemmatizer models by @gadde5300 in Updated lemmatizer models #7044
• 2022-03-07-stopwords_iso_lij_3_0 by @jsl-models in 2022-03-07-stopwords_iso_lij_3_0 #7046
• 2022-03-07-w2v_cc_300d_it_3_0 by @jsl-models in 2022-03-07-w2v_cc_300d_it_3_0 #7047
• fixed fastText model page title typo by @luca-martial in fixed fastText model page title typo #7048
• 2022-03-07-stopwords_iso_am_3_0 by @jsl-models in 2022-03-07-stopwords_iso_am_3_0 #7133
• 2022-03-07-stopwords_iso_lb_3_0 by @jsl-models in 2022-03-07-stopwords_iso_lb_3_0 #7132
• 2022-03-07-stopwords_iso_sk_3_0 by @jsl-models in 2022-03-07-stopwords_iso_sk_3_0 #7131
• 2022-03-07-stopwords_iso_cs_3_0 by @jsl-models in 2022-03-07-stopwords_iso_cs_3_0 #7130
• 2022-03-07-stopwords_iso_tr_3_0 by @jsl-models in 2022-03-07-stopwords_iso_tr_3_0 #7129
• 2022-03-07-stopwords_iso_hr_3_0 by @jsl-models in 2022-03-07-stopwords_iso_hr_3_0 #7128
• 2022-03-07-stopwords_iso_nl_3_0 by @jsl-models in 2022-03-07-stopwords_iso_nl_3_0 #7127
• 2022-03-07-stopwords_iso_ko_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ko_3_0 #7126
• 2022-03-07-stopwords_iso_eu_3_0 by @jsl-models in 2022-03-07-stopwords_iso_eu_3_0 #7125
• 2022-03-07-stopwords_iso_zh_3_0 by @jsl-models in 2022-03-07-stopwords_iso_zh_3_0 #7124
• 2022-03-07-stopwords_iso_lv_3_0 by @jsl-models in 2022-03-07-stopwords_iso_lv_3_0 #7123
• 2022-03-07-stopwords_iso_tn_3_0 by @jsl-models in 2022-03-07-stopwords_iso_tn_3_0 #7122
• 2022-03-07-stopwords_iso_pl_3_0 by @jsl-models in 2022-03-07-stopwords_iso_pl_3_0 #7121
• 2022-03-07-stopwords_iso_th_3_0 by @jsl-models in 2022-03-07-stopwords_iso_th_3_0 #7120
• 2022-03-07-stopwords_iso_gu_3_0 by @jsl-models in 2022-03-07-stopwords_iso_gu_3_0 #7119
• 2022-03-07-stopwords_iso_grc_3_0 by @jsl-models in 2022-03-07-stopwords_iso_grc_3_0 #7118
• 2022-03-07-stopwords_iso_si_3_0 by @jsl-models in 2022-03-07-stopwords_iso_si_3_0 #7117
• 2022-03-07-stopwords_iso_is_3_0 by @jsl-models in 2022-03-07-stopwords_iso_is_3_0 #7116
• 2022-03-07-stopwords_iso_ky_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ky_3_0 #7115
• 2022-03-07-stopwords_iso_sq_3_0 by @jsl-models in 2022-03-07-stopwords_iso_sq_3_0 #7114
• 2022-03-07-stopwords_iso_ca_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ca_3_0 #7113
• 2022-03-07-stopwords_iso_sa_3_0 by @jsl-models in 2022-03-07-stopwords_iso_sa_3_0 #7112
• 2022-03-07-stopwords_iso_pt_3_0 by @jsl-models in 2022-03-07-stopwords_iso_pt_3_0 #7111
• 2022-03-07-stopwords_iso_ga_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ga_3_0 #7110
• 2022-03-07-stopwords_iso_fr_3_0 by @jsl-models in 2022-03-07-stopwords_iso_fr_3_0 #7109
• 2022-03-07-stopwords_iso_mk_3_0 by @jsl-models in 2022-03-07-stopwords_iso_mk_3_0 #7108
• 2022-03-07-stopwords_iso_es_3_0 by @jsl-models in 2022-03-07-stopwords_iso_es_3_0 #7107
• 2022-03-07-stopwords_iso_tt_3_0 by @jsl-models in 2022-03-07-stopwords_iso_tt_3_0 #7106
• 2022-03-07-stopwords_iso_nb_3_0 by @jsl-models in 2022-03-07-stopwords_iso_nb_3_0 #7105
• 2022-03-07-stopwords_iso_uk_3_0 by @jsl-models in 2022-03-07-stopwords_iso_uk_3_0 #7104
• 2022-03-07-stopwords_iso_bn_3_0 by @jsl-models in 2022-03-07-stopwords_iso_bn_3_0 #7103
• 2022-03-07-stopwords_iso_lt_3_0 by @jsl-models in 2022-03-07-stopwords_iso_lt_3_0 #7102
• 2022-03-07-stopwords_iso_tl_3_0 by @jsl-models in 2022-03-07-stopwords_iso_tl_3_0 #7101
• 2022-03-07-stopwords_iso_id_3_0 by @jsl-models in 2022-03-07-stopwords_iso_id_3_0 #7100
• 2022-03-07-stopwords_iso_hu_3_0 by @jsl-models in 2022-03-07-stopwords_iso_hu_3_0 #7099
• 2022-03-07-stopwords_iso_ti_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ti_3_0 #7098
• 2022-03-07-stopwords_iso_he_3_0 by @jsl-models in 2022-03-07-stopwords_iso_he_3_0 #7097
• 2022-03-07-stopwords_iso_it_3_0 by @jsl-models in 2022-03-07-stopwords_iso_it_3_0 #7096
• 2022-03-07-stopwords_iso_ta_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ta_3_0 #7095
• 2022-03-07-stopwords_iso_sr_3_0 by @jsl-models in 2022-03-07-stopwords_iso_sr_3_0 #7094
• 2022-03-07-stopwords_iso_da_3_0 by @jsl-models in 2022-03-07-stopwords_iso_da_3_0 #7093
• 2022-03-07-stopwords_iso_te_3_0 by @jsl-models in 2022-03-07-stopwords_iso_te_3_0 #7092
• 2022-03-07-stopwords_iso_sv_3_0 by @jsl-models in 2022-03-07-stopwords_iso_sv_3_0 #7091
• 2022-03-07-stopwords_iso_kn_3_0 by @jsl-models in 2022-03-07-stopwords_iso_kn_3_0 #7090
• 2022-03-07-stopwords_iso_de_3_0 by @jsl-models in 2022-03-07-stopwords_iso_de_3_0 #7089
• 2022-03-07-stopwords_iso_ml_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ml_3_0 #7088
• 2022-03-07-stopwords_iso_et_3_0 by @jsl-models in 2022-03-07-stopwords_iso_et_3_0 #7087
• 2022-03-07-stopwords_iso_bg_3_0 by @jsl-models in 2022-03-07-stopwords_iso_bg_3_0 #7086
• 2022-03-07-stopwords_iso_hi_3_0 by @jsl-models in 2022-03-07-stopwords_iso_hi_3_0 #7085
• 2022-03-07-stopwords_iso_ro_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ro_3_0 #7084
• 2022-03-07-stopwords_iso_el_3_0 by @jsl-models in 2022-03-07-stopwords_iso_el_3_0 #7083
• 2022-03-07-stopwords_iso_hy_3_0 by @jsl-models in 2022-03-07-stopwords_iso_hy_3_0 #7082
• 2022-03-07-stopwords_iso_ja_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ja_3_0 #7081
• 2022-03-07-stopwords_iso_az_3_0 by @jsl-models in 2022-03-07-stopwords_iso_az_3_0 #7080
• 2022-03-07-stopwords_iso_ne_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ne_3_0 #7079
• 2022-03-07-stopwords_iso_ar_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ar_3_0 #7077
• 2022-03-07-stopwords_iso_en_3_0 by @jsl-models in 2022-03-07-stopwords_iso_en_3_0 #7078
• 2022-03-07-stopwords_iso_af_3_0 by @jsl-models in 2022-03-07-stopwords_iso_af_3_0 #7076
• 2022-03-07-stopwords_iso_ur_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ur_3_0 #7075
• 2022-03-07-stopwords_iso_ru_3_0 by @jsl-models in 2022-03-07-stopwords_iso_ru_3_0 #7074
• 2022-03-07-stopwords_iso_fa_3_0 by @jsl-models in 2022-03-07-stopwords_iso_fa_3_0 #7073
• 2022-03-07-stopwords_iso_sl_3_0 by @jsl-models in 2022-03-07-stopwords_iso_sl_3_0 #7072
• 2022-03-07-stopwords_iso_mr_3_0 by @jsl-models in 2022-03-07-stopwords_iso_mr_3_0 #7071
• 2022-03-07-stopwords_iso_fi_3_0 by @jsl-models in 2022-03-07-stopwords_iso_fi_3_0 #7070
• 2022-03-07-stopwords_iso_vi_3_0 by @jsl-models in 2022-03-07-stopwords_iso_vi_3_0 #7069
• Update 2022-03-07-stopwords_iso_lij_3_0.md by @gadde5300 in Update 2022-03-07-stopwords_iso_lij_3_0.md #7135
• 2022-03-08-distilbert_token_classifier_typo_detector_pipeline_en_3_0 by @jsl-models in 2022-03-08-distilbert_token_classifier_typo_detector_pipeline_en_3_0 #7134
• 2022-03-08-distilbert_token_classifier_typo_detector_pipeline_is_3_0 by @jsl-models in 2022-03-08-distilbert_token_classifier_typo_detector_pipeline_is_3_0 #7136
• Fix path to S3 for some models which were renamed by @maziyarpanahi in Fix path to S3 for some models which were renamed #7043
• 2022-03-08-lemma_spacylookup_nb_3_0 by @jsl-models in 2022-03-08-lemma_spacylookup_nb_3_0 #7139
• 2022-03-08-lemma_spacylookup_grc_3_0 by @jsl-models in 2022-03-08-lemma_spacylookup_grc_3_0 #7140
• 2022-03-08-lemma_spacylookup_en_3_0 by @jsl-models in 2022-03-08-lemma_spacylookup_en_3_0 #7141
• 2022-03-08-lemma_spacylookup_pt_3_0 by @jsl-models in 2022-03-08-lemma_spacylookup_pt_3_0 #7142
• Fixed typos in lemmas and stopwords by @gadde5300 in Fixed typos in lemmas and stopwords #7138
• Update analyze_medical_text_spanish.md by @agsfer in Update analyze_medical_text_spanish.md #7040
• Created md file for posology_re model by @bunyamin-polat in Created md file for posology_re model #7037
• Deleted md file by @bunyamin-polat in Deleted md file #6944
• Models hub by @maziyarpanahi in Models hub #7147
• Changes bad error name in python section by @josejuanmartinez in Changes bad error name in python section #6540
• 342-release-candidate by @maziyarpanahi in 342-release-candidate #6979
• 2022-03-10-deberta_v3_base_en_3_0 by @jsl-models in 2022-03-10-deberta_v3_base_en_3_0 #7150
• 2022-03-10-deberta_v3_large_en_3_0 by @jsl-models in 2022-03-10-deberta_v3_large_en_3_0 #7152
• 2022-03-10-deberta_v3_small_en_3_0 by @jsl-models in 2022-03-10-deberta_v3_small_en_3_0 #7153
• 2022-03-10-deberta_v3_xsmall_en_3_0 by @jsl-models in 2022-03-10-deberta_v3_xsmall_en_3_0 #7154
• 2022-03-10-mdeberta_v3_base_xx_3_0 by @jsl-models in 2022-03-10-mdeberta_v3_base_xx_3_0 #7155
• Models hub by @maziyarpanahi in Models hub #7156

New Contributors

• @mahmoodbayeshi made their first contribution in Feature NMH-65: Collect and use statistics on downloads of model #6835
• @bunyamin-polat made their first contribution in Updated md files #6969

Full Changelog: 3.4.1...3.4.2

---

This discussion was created from the release John Snow Labs Spark-NLP 3.4.2: DeBERTa embeddings, new caching in Word2Vec and Doc2Vec, new state-of-the-art models, and bug fixes!.