i have performed some design proposals in the confluence space.
see the following links:
KVStore for Distributed Model Parallel FC(nsoftmax)
KVStore for Partial FC(nsoftmax) for Large Scale Data Training
End2End Fixpoint Finetuning Plug-In
welcome anybody to join me to finish them into the master branch of mxnet.