Gluon does not support model serving. However you can use MXNet Model Server (MMS) to server your model. You simply need to export the model as josn (see this explanation for an example), save the parameters (see this tutorial), and follow instructions on creating a model using mxnet-model-export (see docs here).
3 Likes