Chinese erlangshen_roberta_330m_causal_chinese_pipeline pipeline BertForSequenceClassification from IDEA-CCNL

Description

Pretrained BertForSequenceClassification, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.erlangshen_roberta_330m_causal_chinese_pipeline is a Chinese model originally trained by IDEA-CCNL.

Download Copy S3 URI

How to use


pipeline = PretrainedPipeline("erlangshen_roberta_330m_causal_chinese_pipeline", lang = "zh")
annotations =  pipeline.transform(df)   


val pipeline = new PretrainedPipeline("erlangshen_roberta_330m_causal_chinese_pipeline", lang = "zh")
val annotations = pipeline.transform(df)

Model Information

Model Name: erlangshen_roberta_330m_causal_chinese_pipeline
Type: pipeline
Compatibility: Spark NLP 5.5.0+
License: Open Source
Edition: Official
Language: zh
Size: 1.2 GB

References

https://huggingface.co/IDEA-CCNL/Erlangshen-Roberta-330M-Causal-Chinese

Included Models

  • DocumentAssembler
  • TokenizerModel
  • BertForSequenceClassification