Use mxnet with other deep learning tool

Plan to use another deep learning tool with mxnet , problem is, cuda is executed in streams and cudnn is allocated for each stream. If mxnet is initialising cudnn with some incompatible way, the lib I am using will not work. Any suggestion about this case? Not familiar with cuda but this is what the engineers told me.