MxNet installation on M1 Mac with Miniconda - (not a mach-o file) Error

1

Hi’ I’ve been tryig to install MxNet on a M1 Mac, and I’m using Miniconda, which supposedly supports arm-based packages installations.

I created the env by:

conda create --name mc_mxnet_py39 python=3.9

and installed mxnet by:

pip install --upgrade mxnet

I also tried specifying

CONDA_SUBDIR=osx-arm64 pip install --upgrade mxnet

But the result is always the same, when importing mxnet I get the error:

OSError: dlopen(/Users/cdemasi/miniconda3/envs/mc_mxnet_py39/lib/python3.9/site-packages/mxnet/libmxnet.so, 0x0006): tried: '/Users/cdemasi/miniconda3/envs/mc_mxnet_py39/lib/python3.9/site-packages/mxnet/libmxnet.so' (not a mach-o file)

During the installation, I see that it’s doing:

Collecting mxnet
Using cached mxnet-1.6.0-py2.py3-none-any.whl (68.7 MB)

So, I assume there’s an error in the mxnet-1.6.0-py2.py3-none-any.whl file, which is actually not a Mac-compatible version?

2

Are you able to solve this issue?

3

Not yet, at least not completely. I opened an issue regarding this problem, but I’ve been mostly ignored so far.
As you can read there, I was able to compile MxNet 2.0.0, so maybe that is gonna solve your problem.

1 Like
4

Quite Helpful, but some commands are still not working for me :slightly_frowning_face: Anyways, Thanks! Do share if you find any other solution.

5

I just had the same problem as you. I created a virtual environment for python 3.10, and then reinstalled mxnet. This problem did not arise again.

6

Are you sure that’s exactly what you did? i just tried it, and it doesn’t work for me. I created a virtual environment for Python 3.10 with conda, installed (without errors) mxnet 1.6.0, but still having the same issue when importing it.

7

Yes,sure. My python version in 3.10.6 based on Anaconda, my laptop is mbp16(2021,m1pro). Maybe there is something wrong with Miniconda.

8

Yes, that’s the whole point :slight_smile:
It works with Anaconda because you get the x86_64 version, which is then executed under Rosetta2.

I was asking about installation with Miniconda because it supposedly supports the arm-based architecture of the M1, but as I said, it doesn’t currently work (for reference, with PyTorch and Tensorflow you can install the arm-based versions, and even use the integrated GPU on the M1).

9

But I have to say that the deep learning speed of the M1pro is really not as good as that of a desktop-level graphics card. I ended up opting for a cloud GPU server (3080), which was 10x faster.

10

I totally agree, but I’m forced to use the Mac for work, hence the question :slight_smile:

11

Please try compiling from source following the instructions in the link:

Only, please make sure that instead of git cloning recursive command which ends up installing mxnet 2.0.0. Get the 1.9.1 source from the mxnet downloads section and compile them & also make sure that you turn off and play around with the cmake config file by switching off CUDA or x86 related settings.

This approach worked for me: mxnet 1.9.1 & Python 3.7.13 (not sure if the python version makes sense, I figured out this combination from their official docker release which uses this combination. Other higher Python versions also should work. )

In parallel, I raised an issue (AttributeError when importing DeepAREstimator: module 'mxnet.gluon' has no attribute 'ParameterDict' · Issue #2451 · awslabs/gluonts · GitHub) and got the same response that mxnet 2.0.0 is not compatible with gluonTS.

13

Hi tmbsundar, I’m following your steps, still I’m not successful. To make sure, I’m doing all steps right - 1) are you using apache-mxnet-src-1.9.1-incubating.tar.gz 2) could you please post or line where you changed in config file, it looks the default selection in config is gpu option off. 3) I am using python 3.11 and 3.9, is mxnet compatible only with 3.7.13?

I tried donwloading 1.9.1 from mxnet, ended up error at make step and also tried using 1.9.1 version from github. Looking forward to your input, much appreciated.
Thanks
[/quote]