distribution of training on multiple nodes
-
distribute model on multiple GPUs -
use horovood to distribute on multiple nodes
maybe worth to read: https://theaisummer.com/distributed-training/
maybe worth to read: https://theaisummer.com/distributed-training/