Can someone explain and provide a quick tutorial on what is KV store?
When and how to use it?
You can check this tutorial: https://mxnet.incubator.apache.org/versions/master/tutorials/python/kvstore.html
The KVStore is the data store used to aggregate the gradients, especially relevant when you use multiple GPUs or multiple hosts. You usually don’t need to worry about it, the Trainer
takes care of creating it. There are different kvstores, device
means it is stored on gpu. local
means CPU. The dist
prefix is used for distributed training across multiple hosts. Full API details can be found here: http://mxnet.incubator.apache.org/api/python/kvstore/kvstore.html#mxnet.kvstore.create