I noticed there has been some activity regarding TF’s 8 bit quantization, primarily by ‘lissyx’: https://github.com/mozilla/DeepSpeech/issues?utf8=✓&q=quantize
It appears the branches were not merged into master. I can see some earlier work resulted in significant increase in WER: https://github.com/mozilla/DeepSpeech/issues/133#issuecomment-263559215
Can anyone share any information on the past effort or future directions regarding quantization – does anyone plan to pursue it?
Thanks!