Letzeburgesch, Luxembourgish wav2vec2_base_luxembourgish_4h_with_lm Wav2Vec2ForCTC from Lemswasabi

Description

Pretrained Wav2Vec2ForCTC model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.wav2vec2_base_luxembourgish_4h_with_lm is a Letzeburgesch, Luxembourgish model originally trained by Lemswasabi.

Download Copy S3 URI

How to use

     
audioAssembler = AudioAssembler() \
	.setInputCol("audio_content") \
	.setOutputCol("audio_assembler")

speechToText  = Wav2Vec2ForCTC.pretrained("wav2vec2_base_luxembourgish_4h_with_lm","lb") \
     .setInputCols(["audio_assembler"]) \
     .setOutputCol("text")

pipeline = Pipeline().setStages([audioAssembler, speechToText])
pipelineModel = pipeline.fit(data)
pipelineDF = pipelineModel.transform(data)


val audioAssembler = new DocumentAssembler()
    .setInputCols("audio_content")
    .setOutputCols("audio_assembler")

val speechToText = Wav2Vec2ForCTC.pretrained("wav2vec2_base_luxembourgish_4h_with_lm", "lb")
    .setInputCols(Array("audio_assembler")) 
    .setOutputCol("text") 
    
val pipeline = new Pipeline().setStages(Array(documentAssembler, speechToText))
val pipelineModel = pipeline.fit(data)
val pipelineDF = pipelineModel.transform(data)

Model Information

Model Name: wav2vec2_base_luxembourgish_4h_with_lm
Compatibility: Spark NLP 5.5.1+
License: Open Source
Edition: Official
Input Labels: [audio_assembler]
Output Labels: [text]
Language: lb
Size: 233.1 MB

References

https://huggingface.co/Lemswasabi/wav2vec2-base-luxembourgish-4h-with-lm