Description
Pretrained Wav2vec2 model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.asr_exp_w2v2t_xls_r_s417 is a Italian model originally trained by jonatasgrosman.
NOTE: This model only works on a CPU, if you need to use this model on a GPU device please use asr_exp_w2v2t_xls_r_s417_gpu
How to use
audio_assembler = AudioAssembler() \
.setInputCol("audio_content") \
.setOutputCol("audio_assembler")
speech_to_text = Wav2Vec2ForCTC \
.pretrained("asr_exp_w2v2t_xls_r_s417", "it")\
.setInputCols("audio_assembler") \
.setOutputCol("text")
pipeline = Pipeline(stages=[
audio_assembler,
speech_to_text,
])
pipelineModel = pipeline.fit(audioDf)
pipelineDF = pipelineModel.transform(audioDf)
Model Information
| Model Name: | asr_exp_w2v2t_xls_r_s417 |
| Compatibility: | Spark NLP 4.2.0+ |
| License: | Open Source |
| Edition: | Official |
| Input Labels: | [audio_assembler] |
| Output Labels: | [text] |
| Language: | it |
| Size: | 1.2 GB |