Cannot use grain with pyarrow on Mac M1 Pro

[jan-engelmann]

Hi,
I am running in to compatiblitgy issues with grain and pands with pyarrow:

I get:

WARNING:absl:Failed to import TraceAnnotation.
[mutex.cc : 452] RAW: Lock blocking 0x10351a128   @

and the import does not finish.

Here is the minimal reproducible example:

➜  uv venv test
Using CPython 3.11.12
Creating virtual environment at: test
Activate with: source test/bin/activate
➜  source test/bin/activate
(test) ➜  uv pip install grain pandas pyarrow
Using Python 3.11.12 environment at: test
Resolved 21 packages in 42ms
Installed 21 packages in 95ms
 + absl-py==2.3.1
 + array-record==0.8.1
 + attrs==25.3.0
 + cloudpickle==3.1.1
 + dm-tree==0.1.9
 + etils==1.13.0
 + fsspec==2025.9.0
 + grain==0.2.12
 + importlib-resources==6.5.2
 + more-itertools==10.8.0
 + numpy==2.3.3
 + pandas==2.3.2
 + protobuf==6.32.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2025.2
 + six==1.17.0
 + typing-extensions==4.15.0
 + tzdata==2025.2
 + wrapt==1.17.3
 + zipp==3.23.0
(test) ➜  python -c "import pandas as pd;import grain"
WARNING:absl:Failed to import TraceAnnotation.
[mutex.cc : 452] RAW: Lock blocking 0x10351a128   @

Thanks a lot!

Cheers,
Jan

[jan-engelmann]

The workaround pinning "array_record<0.8" from #1023 works:

➜  uv venv test                                   
Using CPython 3.11.12
Creating virtual environment at: test
Activate with: source test/bin/activate
➜  source test/bin/activate
(test) ➜  uv pip install pandas pyarrow grain "array_record<0.8"
Using Python 3.11.12 environment at: test
Resolved 21 packages in 76ms
Installed 21 packages in 137ms
 + absl-py==2.3.1
 + array-record==0.7.2
 + attrs==25.3.0
 + cloudpickle==3.1.1
 + dm-tree==0.1.9
 + etils==1.13.0
 + fsspec==2025.9.0
 + grain==0.2.11
 + importlib-resources==6.5.2
 + more-itertools==10.8.0
 + numpy==2.3.3
 + pandas==2.3.2
 + protobuf==6.32.1
 + pyarrow==21.0.0
 + python-dateutil==2.9.0.post0
 + pytz==2025.2
 + six==1.17.0
 + typing-extensions==4.15.0
 + tzdata==2025.2
 + wrapt==1.17.3
 + zipp==3.23.0
(test) ➜  python -c "import pandas as pd;import grain"     

[amifalk]

For grain devs, the pyproject.toml file needs to be updated to allow array record versions below 0.8.0a1 in order to add grain as a dependency for mac builds of other projects.

grain/pyproject.toml

Line 15 in bab58ea

"array-record>=0.8.0a1; sys_platform != 'win32'",