Description
Pretrained ViTForImageClassification model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.vit_base_patch16_224_finetuned_imageclds is a English model originally trained by NadaElmasry.
How to use
image_assembler = ImageAssembler()\
.setInputCol("image")\
.setOutputCol("image_assembler")
imageClassifier = ViTForImageClassification.pretrained(""vit_base_patch16_224_finetuned_imageclds","en")\
.setInputCols("image_assembler")\
.setOutputCol("class")
pipeline = Pipeline(stages=[
image_assembler,
imageClassifier,
])
pipelineModel = pipeline.fit(imageDF)
pipelineDF = pipelineModel.transform(imageDF)
val imageAssembler = new ImageAssembler()
.setInputCol("image")
.setOutputCol("image_assembler")
val imageClassifier = ViTForImageClassification.pretrained("vit_base_patch16_224_finetuned_imageclds","en")
.setInputCols("image_assembler")
.setOutputCol("class")
val pipeline = new Pipeline().setStages(Array(imageAssembler, imageClassifier))
val pipelineModel = pipeline.fit(imageDF)
val pipelineDF = pipelineModel.transform(imageDF)
Model Information
| Model Name: | vit_base_patch16_224_finetuned_imageclds |
| Compatibility: | Spark NLP 5.5.1+ |
| License: | Open Source |
| Edition: | Official |
| Input Labels: | [image_assembler] |
| Output Labels: | [label] |
| Language: | en |
| Size: | 321.3 MB |
References
https://huggingface.co/NadaElmasry/vit-base-patch16-224-finetuned-imageclds