SparkNLP 1077- Introducing Qwen2 - VL

[prabod]

This PR Integrates Qwen2-VL family models into SparkNLP

Screenshots (if appropriate):

Types of changes

• Code improvements with no or little impact
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• My code follows the code style of this project.
• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have read the CONTRIBUTING page.
• I have added tests to cover my changes.
• All new and existing tests passed.

[coveralls]

Pull Request Test Coverage Report for Build 12251433223

Details

• 24 of 417 (5.76%) changed or added relevant lines in 13 files are covered.
• 57 unchanged lines in 37 files lost coverage.
• Overall coverage decreased (-0.9%) to 59.492%

---

Changes Missing Coverage	Covered Lines	Changed/Added Lines	%
src/main/scala/com/johnsnowlabs/nlp/HasBatchedAnnotateImage.scala	0	2	0.0%
src/main/scala/com/johnsnowlabs/nlp/ImageAssembler.scala	8	10	80.0%
src/main/scala/com/johnsnowlabs/nlp/annotators/tokenizer/bpe/BpeTokenizer.scala	1	3	33.33%
src/main/scala/com/johnsnowlabs/nlp/annotators/cv/feature_extractor/Preprocessor.scala	0	3	0.0%
src/main/scala/com/johnsnowlabs/nlp/pretrained/PretrainedPipeline.scala	0	4	0.0%
src/main/scala/com/johnsnowlabs/nlp/annotators/tokenizer/bpe/BpeSpecialTokens.scala	0	6	0.0%
src/main/scala/com/johnsnowlabs/nlp/AnnotationImage.scala	2	10	20.0%
src/main/scala/com/johnsnowlabs/nlp/LightPipeline.scala	13	34	38.24%
src/main/scala/com/johnsnowlabs/nlp/annotators/tokenizer/bpe/Qwen2VLTokenizer.scala	0	24	0.0%
src/main/scala/com/johnsnowlabs/nlp/annotators/tokenizer/bpe/BertTokenizer.scala	0	26	0.0%

Files with Coverage Reduction	New Missed Lines	%
src/main/scala/com/johnsnowlabs/nlp/util/SparkNlpConfig.scala	1	50.0%
src/main/scala/com/johnsnowlabs/nlp/annotators/er/EntityRulerModel.scala	1	90.4%
src/main/scala/com/johnsnowlabs/nlp/annotators/ner/dl/NerDLModel.scala	1	58.23%
src/main/scala/com/johnsnowlabs/nlp/annotators/spell/norvig/NorvigSweetingModel.scala	1	84.17%
src/main/scala/com/johnsnowlabs/nlp/annotators/cv/util/transform/ImageResizeUtils.scala	1	81.4%
src/main/scala/com/johnsnowlabs/nlp/annotators/keyword/yake/YakeKeywordExtraction.scala	1	97.44%
src/main/scala/com/johnsnowlabs/nlp/annotators/TextSplitter.scala	1	94.44%
src/main/scala/com/johnsnowlabs/nlp/annotators/tokenizer/moses/MosesTokenizer.scala	1	96.55%
src/main/scala/com/johnsnowlabs/nlp/annotators/DocumentCharacterTextSplitter.scala	1	96.72%
src/main/scala/com/johnsnowlabs/nlp/AnnotationImage.scala	1	23.53%

Totals
Change from base Build 12237686398:	-0.9%
Covered Lines:	9223
Relevant Lines:	15503

---

💛 - Coveralls