What are alternatives to update_on_kvstore?


I see that update_on_kvstore can be set to False or None. What happens in both those cases? Apart from ring-allreduce and single-device single-model situations I don’t see any situation where updates could be done without a kvstore? the doc is not clear on the role of that parameter