is possible train with tensor cores?

[ARCS (ARCSX)]

I have a gpu with tensor cores and I wanted to know if it is possible to use them for training / testing. Thanks.

[lissyx]

gpu with tensor cores

Can you be a bit more specific? Basically, we don’t control that, it’s up-to TensorFlow, so if it’s supported by TensorFlow r1.12, it will work.

[ARCS (ARCSX)]

From what I understand, to take advantage of the tensor cores FP16/8 is needed. Is it possible to train and test some model with FP16? Or do I have to make the necessary modifications in the model for its operation? Thanks for your time.

[carlfm01 (Carlos Fonseca)]

Or do I have to make the necessary modifications in the model for its operation

Yes.

Here’s a example of how to change your model to use FP16 : FP16 pdf Tensorflow at page 50 starts the Tensorflow examples.
I recommend you to read the whole pdf.

[carlfm01 (Carlos Fonseca)]

@ARCS This may interest you “Automatic Mixed Precision for NVIDIA Tensor Core Architecture in TensorFlow”

https://devblogs.nvidia.com/nvidia-automatic-mixed-precision-tensorflow/