Hi,
When I continue training with the pre-trained English model 0.1.1 to add Indian accent, I can tune hyperparameters as needed.
As @kdavis said, the logic behind the hyperparameters is mostly hard-won trial and error. But I would like to know, from your experience, if there are any recommended range for each hyperparameter. In which order should I tune each hyperparameter ?
Hyperparameters from the pre-trained model:
train_batch_size 12
dev_batch_size 8
test_batch_size 8
epoch 13
dropout_rate 0.2367
default_stddev 0.046875
I guess the following hyperparameters doesn’t need to be change:
learning_rate 0.0001
n_hidden 2048
validation_step 1
Thanks,
Tan