Is there a quick way in gluon or mxnet to get model parameter count?
Yes, try net.summary(). It should display number of parameters per block and total number as well.