English opendispatcher_v5_gpt35turbo_and_gpt4_pipeline pipeline DistilBertForSequenceClassification from gaodrew

Description

Pretrained DistilBertForSequenceClassification, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.opendispatcher_v5_gpt35turbo_and_gpt4_pipeline is a English model originally trained by gaodrew.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("opendispatcher_v5_gpt35turbo_and_gpt4_pipeline", lang = "en")
annotations =  pipeline.transform(df)   


val pipeline = new PretrainedPipeline("opendispatcher_v5_gpt35turbo_and_gpt4_pipeline", lang = "en")
val annotations = pipeline.transform(df)

Model Information

Model Name: opendispatcher_v5_gpt35turbo_and_gpt4_pipeline
Type: pipeline
Compatibility: Spark NLP 5.5.0+
License: Open Source
Edition: Official
Language: en
Size: 249.5 MB

References

https://huggingface.co/gaodrew/OpenDispatcher_v5_gpt35turbo_and_gpt4

Included Models

  • DocumentAssembler
  • TokenizerModel
  • DistilBertForSequenceClassification