Apple M1, Arm64: Pip subprocess to install build dependencies did not run successfully.

[the-trumpeter]

I'm trying to install SpaCy on my MacBook Pro 2020 13" (M1, Arm64. Model no. MYD92X/A) to run a friend's conlang, but am encountering quite a few errors. It seems whenever I use pip, something goes wrong... although pip itself is not the problem in this case.

I have Python 3.13.2 installed, at this time the latest version, and it is the M1/Arm version. I installed it manually.
Pip, Ninja, Numpy are all up-to-date. (the latter two because I spotted them mentioned in the output and ensured their latest version)

I'm following the install instructions for MacOS/OSX, Arm/M1 from spacy.io.
So far:

• pip install -U pip setuptools wheel ran successfully.
• pip install -U 'spacy[apple]' is failing:

Update:
My smart friend tells me these lines are probably important:

FAILED: numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_string_ufuncs.cpp.o
            c++ -Inumpy/_core/_multiarray_umath.cpython-313-darwin.so.p -Inumpy/_core -I../numpy/_core -Inumpy/_core/include -I../numpy/_core/include -I../numpy/_core/src/common -I../numpy/_core/src/multiarray -I../numpy/_core/src/npymath -I../numpy/_core/src/umath -I../numpy/_core/src/highway -I/Library/Frameworks/Python.framework/Versions/3.13/include/python3.13 -I/private/var/folders/kz/g5tzv2414sq4stttnthy_2fm0000gp/T/pip-install-6xhhsmdd/numpy_251c9eb25e934f69b13932d7cb75476e/.mesonpy-v4a11nqt/meson_cpu -fvisibility=hidden -fvisibility-inlines-hidden -fdiagnostics-color=always -DNDEBUG -Wall -Winvalid-pch -std=c++17 -O3 -ftrapping-math -DNPY_HAVE_CLANG_FPSTRICT -DNPY_HAVE_NEON_VFPV4 -DNPY_HAVE_NEON_FP16 -DNPY_HAVE_NEON -DNPY_HAVE_ASIMD -F/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/System/Library/Frameworks/Accelerate.framework -idirafter/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/System/Library/Frameworks/Accelerate.framework/Headers -DACCELERATE_NEW_LAPACK -DHAVE_CBLAS '-DBLAS_SYMBOL_SUFFIX=$NEWLAPACK' -DNPY_INTERNAL_BUILD -DHAVE_NPY_CONFIG_H -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -D__STDC_VERSION__=0 -fno-exceptions -fno-rtti -MD -MQ numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_string_ufuncs.cpp.o -MF numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_string_ufuncs.cpp.o.d -o numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_string_ufuncs.cpp.o -c ../numpy/_core/src/umath/string_ufuncs.cpp
            In file included from ../numpy/_core/src/umath/string_ufuncs.cpp:20:
            ../numpy/_core/src/umath/string_fastsearch.h:132:5: error: no type named 'ptrdiff_t' in namespace 'std'; did you mean simply 'ptrdiff_t'?
              132 |     std::ptrdiff_t
                  |     ^~~~~~~~~~~~~~
                  |     ptrdiff_t

I have numpy 2.2.4, as shown:

XX@###-###-##-### ~ % pip show numpy
Name: numpy
Version: 2.2.4
Summary: Fundamental package for array computing in Python
Home-page: https://numpy.org
Author: Travis E. Oliphant et al.
Author-email: 
License: Copyright (c) 2005-2024, NumPy Developers.
 All rights reserved.

Here is the abbreviated output: (x used for censorship, […] is abbreviated output.)

XX@XXsMacBookPro ~ % pip install -U 'spacy[apple]'
Collecting spacy[apple]
  Using cached spacy-3.8.2.tar.gz (1.3 MB)
  Installing build dependencies ... error
  error: subprocess-exited-with-error
  
  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [681 lines of output]
  Ignoring numpy: markers 'python_version < "3.9"' don't match your environment
  [...collection...]
  Collecting numpy<2.1.0,>=2.0.0
        Using cached numpy-2.0.2.tar.gz (18.9 MB)
        Installing build dependencies: started
        Installing build dependencies: finished with status 'done'
        Getting requirements to build wheel: started
        Getting requirements to build wheel: finished with status 'done'
        Preparing metadata (pyproject.toml): started
        Preparing metadata (pyproject.toml): finished with status 'error'
        error: subprocess-exited-with-error
      
        × Preparing metadata (pyproject.toml) did not run successfully.
        │ exit code: 1
        ╰─> [639 lines of output]
           
           [...lots of specifications here...]
           
            7 errors generated.
            [249/322] Compiling C++ object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_clip.cpp.o
            [250/322] Compiling C++ object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_special_integer_comparisons.cpp.o
            [251/322] Compiling C object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath__scaled_float_dtype.c.o
            [252/322] Compiling C object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_umathmodule.c.o
            [253/322] Compiling C++ object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_stringdtype_ufuncs.cpp.o
            [254/322] Compiling C object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_umath_ufunc_object.c.o
            [255/322] Compiling C++ object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_npysort_selection.cpp.o
            [256/322] Compiling C++ object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_npysort_quicksort.cpp.o
            [257/322] Compiling C++ object numpy/_core/_multiarray_umath.cpython-313-darwin.so.p/src_npysort_timsort.cpp.o
            ninja: build stopped: subcommand failed.
            [end of output]
      
        note: This error originates from a subprocess, and is likely not a problem with pip.
      error: metadata-generation-failed
      
      × Encountered error while generating package metadata.
      ╰─> See above for output.
      
      note: This is an issue with the package mentioned above, not pip.
      hint: See above for details.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.
XX@XXsMacBookPro ~ % 

That's the abbreviated output.
Linked below is the full unedited output, as a plaintext file.

I have done multiple web searches to no avail, and have tried ChatGPT too. Can't seem to resolve it, unfortunately!
Any help appreciated!
Thanks!

the-trumpeter

spaCy_Discussion_13794_the-trumpeter.txt

[the-trumpeter]

@SpookyDervish

[SpookyDervish]

Hi! Did you ever figure this out?

From looking at the full error message, my guess is that your numpy version is either too new or too old, but that's just a guess. Try looking at the requirements for spacy, and seeing what version of numpy would be supported.

[the-trumpeter]

I HAVE NUMPY 2.24! THAT IS IN THE REQUIREMENTS!

And what are the cons to creating a venv

[SpookyDervish]

I didn't see the Python version lol, that's your issue.

There aren't really any cons to creating a venv, it's just a mini Python interpreter, that is seperate from the rest of your computer.

[the-trumpeter]

You can create a virtual environment, which means you shouldn't have any issues with dependencies.

To create a virtual environment, you can type this command: you can replace "my_venv" with what you want to name your virtual environment python3 -m venv my_venv

A folder named "my_venv" will be created in your current directory.

Now after creating your virtual, we have to enter/activate your virtual environment, you can do that by running this command: source my_env/bin/activate

Make sure to replace "my_venv" with the name of your virtual environment. After that, you are now good to go!

-SpookyDervish

[honnibal]

I think the problem is the Python version. We haven't been able to get spaCy to support Python 3.13 yet. If you use 3.12 or an earlier version I think it should work.

[the-trumpeter]

THANK YOU!!!!!!
@honnibal Will 3.12.10 work?

[SpookyDervish]

From my own experience, anything below 3.13 works fine.

[docgyneco69]

I would suggest you try to install from scratch using pipx which will automagically create the virtual python and pip environment that will ensure full compatibility with your existing system and Python version. I have just tried on my macbook M2 :

pipx install spacy
Installed package spacy 3.8.7, installed using Python 3.13.3
These apps are now globally available: - spacy
done! ✨ 🌟 ✨

The easiest way to get pipx on your mac is by first installing the homebrew package manager, copy/paste the following in your terminal :

/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

Then simply follow the instructions from the good folks at pipx "https://pipx.pypa.io/stable/" :

> brew install pipx
> pipx ensurepath
> sudo pipx ensurepath --global # optional to allow pipx actions with --global argument

Finally you may now install and run spacy !
pipx install spacy

Cheers,