How do I train a model using transfer learning?

Deep Speech
#1

I want to train a model using transfer learning. How can I do it?

1 Like
#2

What language/dialect do you want to target?

#3

spanish and Portuguese

1 Like
#4

There at lots of was of doing so. Two headed models, taking off the final layer + adding a new final layer, teacher student…

I’m not sure which way will work best for your data set. What research have you see for transfer learning for Spanish and Portuguese?

#5

Currently, I am reading https://www.aaai.org/ocs/index.php/AAAI/AAAI14/paper/viewFile/8181/8869

and I would like to apply it.

#6

Interesting. Haven’t read that.

Out of curiosity, how are you planning to apply HHTL to STT?