Arch Linux

Blueberry7953

Member

Registered: 2023-08-08

Posts: 4

Packages with "python" as dependency seem to be broken

Hi! I was able to install Arch32 successfully and it seems to be running fine, I can install packages with pacman and most of them are working. However, packages that have anything with "python" as a dependency don't seem to work.

For example, I tried to install "reflector" with "sudo pacman -Sy reflector". It installed without any problem, but when I try to use it, it outputs an error: "ModuleNotFoundError: No module named 'Reflector'".
I then removed "reflector" with "sudo pacman -Rns reflector" and tried to build it myself. I cloned this repository and ran "makepkg -s". It downloads and installs dependencies, but then build fails with error "ModuleNotFoundError: No module named 'jaraco.functools'". It looks like both errors are caused by Python not being able to import modules needed, and indeed, if I run interactive Python interpreter and try to import those modules, it fails.

I tried manually installing "python-jaraco.functools" and then "python-jaraco.context" as dependencies, but then build failed again with a different message: "error: invalid command 'egg_info'", and I'm not sure how I can possibly fix this one.

Any ideas why this can be happening and how it can be fixed?

edit1: corrected a typo

edit2: Ok, I read through this topic on the forum. I see I am not the only person affected by this. For now I will just download Reflector.py and run it manually if needed. Good luck to you guys trying to solve this problem! I really appreciate your work.

Last edited by Blueberry7953 (2023-08-10 13:05:38)

Blueberry7953

Member

Registered: 2023-08-08

Posts: 4

Re: Packages with "python" as dependency seem to be broken

When I run "pacman -Ql reflector" i get the following output:

It looks like Reflector.py file was put inside /usr/lib/python3.10/site-packages directory, but pacman automatically installs python3.11. I think this is the reason it can't find the module, because there is no Reflector.py inside the /usr/lib/python3.11/site-packages directory. But still, I don't really understand why this happened and how to properly fix it (well, I can try just manually copying all reflector stuff into /usr/lib/python3.11/site-packages, but this is definitely not the intended way to do things and I'm afraid it will break something in the future)

abaumann

Administrator

From: Zurich

Registered: 2019-11-14

Posts: 1,032

Website

Re: Packages with "python" as dependency seem to be broken

Confirmed:

reflector
Traceback (most recent call last):
  File "/usr/bin/reflector", line 3, in <module>
    import Reflector
ModuleNotFoundError: No module named 'Reflector'

reflector is built against Python 3.10:

reflector /usr/lib/python3.10/site-packages/Reflector.py

Version of python on stable is:

python --version
Python 3.11.3

Reflector requires a rebuild:

pkgctl repo clone --arch32 --protocol https reflector
core-staging-pentium4-build

This results in:

==> ERROR: Failure while downloading https://sources.archlinux32.org/sources … 023.tar.gz

The last version there is https://sources.archlinux32.org/sources … .11.tar.gz, which is way
old.

So I have to adapt https://git.archlinux32.org/reflector32.

Keeping you posted.

sl1pkn07

Member

Registered: 2023-08-06

Posts: 18

Re: Packages with "python" as dependency seem to be broken

not only reflector

[sl1pkn07@AsusR2H ~]$ yay -Qo /usr/lib/python3.10
/usr/lib/python3.10/ está contenido en avahi 0.8+22+gfd482a7-3.2
/usr/lib/python3.10/ está contenido en boost-libs 1.81.0-3.1
/usr/lib/python3.10/ está contenido en btrfs-progs 6.3-2.0
/usr/lib/python3.10/ está contenido en clang 15.0.7-8.0
/usr/lib/python3.10/ está contenido en gpsd 3.25-1.0
/usr/lib/python3.10/ está contenido en i2c-tools 4.3-4.0
/usr/lib/python3.10/ está contenido en ldb 2:2.6.1-1.0
/usr/lib/python3.10/ está contenido en libaccounts-glib 1.26-1.0
/usr/lib/python3.10/ está contenido en libblockdev 2.28-1.0
/usr/lib/python3.10/ está contenido en libftdi 1.5-5.0
/usr/lib/python3.10/ está contenido en libibus 1.5.28-3.0
/usr/lib/python3.10/ está contenido en libimobiledevice 1.3.0-6.0
/usr/lib/python3.10/ está contenido en libnewt 0.52.23-2.0
/usr/lib/python3.10/ está contenido en libplist 2.2.0-6.1
/usr/lib/python3.10/ está contenido en lilv 0.24.20-2.0
/usr/lib/python3.10/ está contenido en llvm 15.0.7-2.1
/usr/lib/python3.10/ está contenido en ninja 1.11.1-3.0
/usr/lib/python3.10/ está contenido en packagekit 1.2.6-1.1
/usr/lib/python3.10/ está contenido en python-distro 1.8.0-2.1
/usr/lib/python3.10/ está contenido en python-lxml 4.9.2-1.1
/usr/lib/python3.10/ está contenido en python-mako 1.2.4-1.1
/usr/lib/python3.10/ está contenido en python-markupsafe 2.1.2-1.1
/usr/lib/python3.10/ está contenido en python-tqdm 4.65.0-1.0
/usr/lib/python3.10/ está contenido en talloc 2.4.0-2.1
/usr/lib/python3.10/ está contenido en util-linux 2.38.1-1.4
/usr/lib/python3.10/ está contenido en xcb-proto 1.15.2-3.0

seems pentium4 repo is hard broken. kde also fails a lot because have outdated packages wich exist in other repos (i486/i686), also, view the files in the packages section is not present. all needs be fixed

greetings

Last edited by sl1pkn07 (2023-08-12 00:52:43)

abaumann

Administrator

From: Zurich

Registered: 2019-11-14

Posts: 1,032

Website

Re: Packages with "python" as dependency seem to be broken

Yes, python is in limbo. And it didn't get easier to bootstrap with all those installer tools. :->

sl1pkn07

Member

Registered: 2023-08-06

Posts: 18

Re: Packages with "python" as dependency seem to be broken

i just sucessful build, litle by litle, the minimal python setup (installer,build,packaging,wheel, etc) with archlinux python-bootstrap util, and then rebuild same packages with actual sources. zero problems so far (disable generate docs with sphinx and disable test)

why no use it?

abaumann

Administrator

From: Zurich

Registered: 2019-11-14

Posts: 1,032

Website

Re: Packages with "python" as dependency seem to be broken

I have problems rebuilding packages by hand and then adding them forcefully to the package archive and database.

I also cannot force the build of the package in the buildmaster (our automatic build system).

See also http://mirror.archlinux32.org/irc-logs/ … 08-12.html

The database is referencing null revisions upstream and/or illegal revisions.

sl1pkn07

Member

Registered: 2023-08-06

Posts: 18

Re: Packages with "python" as dependency seem to be broken

how work that?. sorry. is the first time see that method.

i just use plain pkgbuild and makepkg by hand

Last edited by sl1pkn07 (2023-08-14 19:26:57)

abaumann

Administrator

From: Zurich

Registered: 2019-11-14

Posts: 1,032

Website

Re: Packages with "python" as dependency seem to be broken

Well, this is the build process which is there since 2017 and building the packages automatically. :-)
It's not an alternative build method for the user of Arch32 or so..

sl1pkn07

Member

Registered: 2023-08-06

Posts: 18

Re: Packages with "python" as dependency seem to be broken

is documented? i what to see how work

greetings

abaumann

Administrator

From: Zurich

Registered: 2019-11-14

Posts: 1,032

Website

Re: Packages with "python" as dependency seem to be broken

Yeah, as usual in a software project the source code is the documentation. :-)

https://git.archlinux32.org/builder/

Those are the build scripts, they call devtools32
https://git.archlinux32.org/devtools32

The database itself looks as follows:

https://buildmaster.archlinux32.org/database-layout.png

sl1pkn07

Member

Registered: 2023-08-06

Posts: 18

Re: Packages with "python" as dependency seem to be broken

that can work for do cross-build (generate pentium4 packages) in 64 bits machine?

abaumann

Administrator

From: Zurich

Registered: 2019-11-14

Posts: 1,032

Website

Re: Packages with "python" as dependency seem to be broken

Yes, that's how we build almost all packages, but the i486 subarchitecture, where we run on 486 libvirt.

sl1pkn07

Member

Registered: 2023-08-06

Posts: 18

Re: Packages with "python" as dependency seem to be broken

[sl1pkn07@AsusR2H asciidoc]$ yay -Qo /usr/lib/python3.10
/usr/lib/python3.10/ está contenido en avahi 0.8+22+gfd482a7-3.2
/usr/lib/python3.10/ está contenido en clang 15.0.7-8.0
/usr/lib/python3.10/ está contenido en lilv 0.24.20-2.0
/usr/lib/python3.10/ está contenido en llvm 15.0.7-2.1
/usr/lib/python3.10/ está contenido en python-pep517 0.13.0-1.0

[sl1pkn07@AsusR2H asciidoc]$ yay -Qo /usr/lib/python3.11
/usr/lib/python3.11/ está contenido en asciidoc 10.2.0-3
/usr/lib/python3.11/ está contenido en boost-libs 1.81.0-7.0
/usr/lib/python3.11/ está contenido en btrfs-progs 6.3.3-1
/usr/lib/python3.11/ está contenido en cython 3.0.0-1.0
/usr/lib/python3.11/ está contenido en dbus-python 1.2.18-5.0
/usr/lib/python3.11/ está contenido en gpsd 3.25-2.0
/usr/lib/python3.11/ está contenido en graphviz 8.1.0-2.0
/usr/lib/python3.11/ está contenido en i2c-tools 4.3-4.0
/usr/lib/python3.11/ está contenido en imath 3.1.9-1.0
/usr/lib/python3.11/ está contenido en ldb 2:2.7.2-2.0
/usr/lib/python3.11/ está contenido en libaccounts-glib 1.26-2.0
/usr/lib/python3.11/ está contenido en libblockdev 2.28-4.0
/usr/lib/python3.11/ está contenido en libbytesize 2.8-2.0
/usr/lib/python3.11/ está contenido en libftdi 1.5-5.1
/usr/lib/python3.11/ está contenido en libimobiledevice 1.3.0-9.0
/usr/lib/python3.11/ está contenido en libnewt 0.52.23-2.1
/usr/lib/python3.11/ está contenido en libplist 2.3.0-2.0
/usr/lib/python3.11/ está contenido en libproxy 0.4.18-3.0
/usr/lib/python3.11/ está contenido en libsmbios 2.4.3-6.0
/usr/lib/python3.11/ está contenido en libxml2 2.11.5-1.0
/usr/lib/python3.11/ está contenido en libxslt 1.1.38-1.0
/usr/lib/python3.11/ está contenido en meson 1.1.1-1.1
/usr/lib/python3.11/ está contenido en meson-python 0.13.2-1
/usr/lib/python3.11/ está contenido en ninja 1.11.1-3.1
/usr/lib/python3.11/ está contenido en platformio-git v6.1.10.r13.g897844eb-1
/usr/lib/python3.11/ está contenido en pybind11 2.11.1-1
/usr/lib/python3.11/ está contenido en python 3.11.3-2.0
/usr/lib/python3.11/ está contenido en python-aenum 3.1.11-5
/usr/lib/python3.11/ está contenido en python-ajsonrpc 1.2.0-2
/usr/lib/python3.11/ está contenido en python-anyio 3.7.1-1
/usr/lib/python3.11/ está contenido en python-anytree 2.8.0-62
/usr/lib/python3.11/ está contenido en python-asgiref 3.7.2-1.1
/usr/lib/python3.11/ está contenido en python-async_generator 1.10-8
/usr/lib/python3.11/ está contenido en python-attrs 22.2.0-3
/usr/lib/python3.11/ está contenido en python-autocommand 2.2.2-4.1
/usr/lib/python3.11/ está contenido en python-babel 2.12.1-1
/usr/lib/python3.11/ está contenido en python-bottle 0.12.25-3.0
/usr/lib/python3.11/ está contenido en python-build 0.10.0-4.1
/usr/lib/python3.11/ está contenido en python-cairo 1.24.0-1
/usr/lib/python3.11/ está contenido en python-calver 2022.06.26-2.1
/usr/lib/python3.11/ está contenido en python-can 4.2.2-1
/usr/lib/python3.11/ está contenido en python-certifi 2023.07.22-1
/usr/lib/python3.11/ está contenido en python-cffi 1.15.1-3.0
/usr/lib/python3.11/ está contenido en python-chardet 5.2.0-1.1
/usr/lib/python3.11/ está contenido en python-click 8.1.6-1.1
/usr/lib/python3.11/ está contenido en python-colorama 0.4.6-2.1
/usr/lib/python3.11/ está contenido en python-contourpy 1.1.0-1
/usr/lib/python3.11/ está contenido en python-cppy 1.2.1-6
/usr/lib/python3.11/ está contenido en python-cryptography 41.0.3-1.0
/usr/lib/python3.11/ está contenido en python-cycler 0.11.0-3
/usr/lib/python3.11/ está contenido en python-dateutil 2.8.2-5
/usr/lib/python3.11/ está contenido en python-distro 1.8.0-3
/usr/lib/python3.11/ está contenido en python-editables 0.5-1.0
/usr/lib/python3.11/ está contenido en python-exceptiongroup 1.1.2-1
/usr/lib/python3.11/ está contenido en python-fastjsonschema 2.18.0-1.0
/usr/lib/python3.11/ está contenido en python-flit-core 3.9.0-1.1
/usr/lib/python3.11/ está contenido en python-flit-scm 1.7.0-4
/usr/lib/python3.11/ está contenido en python-fonttools 4.42.0-1
/usr/lib/python3.11/ está contenido en python-gobject 3.44.1-4.1
/usr/lib/python3.11/ está contenido en python-greenlet 2.0.2-4
/usr/lib/python3.11/ está contenido en python-h11 0.14.0-2.1
/usr/lib/python3.11/ está contenido en python-hatch-fancy-pypi-readme 23.1.0-1.0
/usr/lib/python3.11/ está contenido en python-hatch-vcs 0.3.0-4.0
/usr/lib/python3.11/ está contenido en python-hatchling 1.18.0-1.0
/usr/lib/python3.11/ está contenido en python-httptools 0.5.0-2.1
/usr/lib/python3.11/ está contenido en python-idna 3.4-3.0
/usr/lib/python3.11/ está contenido en python-importlib-metadata 5.0.0-5.1
/usr/lib/python3.11/ está contenido en python-inflect 7.0.0-2
/usr/lib/python3.11/ está contenido en python-iniconfig 2.0.0-4.1
/usr/lib/python3.11/ está contenido en python-installer 0.7.0-3.3
/usr/lib/python3.11/ está contenido en python-jaraco.context 4.3.0-3.1
/usr/lib/python3.11/ está contenido en python-jaraco.functools 3.8.1-1.0
/usr/lib/python3.11/ está contenido en python-jaraco.text 3.11.1-3.1
/usr/lib/python3.11/ está contenido en python-jinja 1:3.1.2-4.1
/usr/lib/python3.11/ está contenido en python-jsonschema 4.19.0-1
/usr/lib/python3.11/ está contenido en python-jsonschema-specifications 2023.7.1-1
/usr/lib/python3.11/ está contenido en python-kiwisolver 1.4.4-4
/usr/lib/python3.11/ está contenido en python-lark-parser 1.1.7-2
/usr/lib/python3.11/ está contenido en python-lxml 4.9.2-3
/usr/lib/python3.11/ está contenido en python-mako 1.2.4-3.1
/usr/lib/python3.11/ está contenido en python-markdown 3.4.4-1.0
/usr/lib/python3.11/ está contenido en python-markupsafe 2.1.3-1.1
/usr/lib/python3.11/ está contenido en python-marshmallow 3.19.0-2.0
/usr/lib/python3.11/ está contenido en python-matplotlib 3.7.2-2
/usr/lib/python3.11/ está contenido en python-maturin 1.2.0-1.0
/usr/lib/python3.11/ está contenido en python-more-itertools 10.1.0-1.0
/usr/lib/python3.11/ está contenido en python-mpv 1.0.4-1
/usr/lib/python3.11/ está contenido en python-netifaces 0.11.0-4
/usr/lib/python3.11/ está contenido en python-numpy 1.25.1-1
/usr/lib/python3.11/ está contenido en python-ordered-set 4.1.0-4.1
/usr/lib/python3.11/ está contenido en python-outcome 1.2.0-4
/usr/lib/python3.11/ está contenido en python-packaging 23.1-1.1
/usr/lib/python3.11/ está contenido en python-pathspec 0.11.2-1.0
/usr/lib/python3.11/ está contenido en python-pillow 10.0.0-2
/usr/lib/python3.11/ está contenido en python-pip 23.2.1-1.1
/usr/lib/python3.11/ está contenido en python-platformdirs 3.9.1-1
/usr/lib/python3.11/ está contenido en python-pluggy 1.2.0-1.1
/usr/lib/python3.11/ está contenido en python-ply 3.11-12.1
/usr/lib/python3.11/ está contenido en python-psutil 5.9.5-1.0
/usr/lib/python3.11/ está contenido en python-pycparser 2.21-5.1
/usr/lib/python3.11/ está contenido en python-pydantic 1.10.9-1.0
/usr/lib/python3.11/ está contenido en python-pyelftools 0.29-2
/usr/lib/python3.11/ está contenido en python-pygments 2.16.1-1.0
/usr/lib/python3.11/ está contenido en python-pyparsing 3.0.9-3.0
/usr/lib/python3.11/ está contenido en python-pyproject-hooks 1.0.0-5.2
/usr/lib/python3.11/ está contenido en python-pyproject-metadata 0.7.1-2
/usr/lib/python3.11/ está contenido en python-pyrsistent 0.19.3-3.1
/usr/lib/python3.11/ está contenido en python-pyserial 3.5-5.1
/usr/lib/python3.11/ está contenido en python-pytest 7.4.0-1
/usr/lib/python3.11/ está contenido en python-pytz 2023.3-1.1
/usr/lib/python3.11/ está contenido en python-referencing 0.30.2-1
/usr/lib/python3.11/ está contenido en python-requests 2.28.2-4.0
/usr/lib/python3.11/ está contenido en python-rpds-py 0.9.2-1
/usr/lib/python3.11/ está contenido en python-semantic-version 2.10.0-3
/usr/lib/python3.11/ está contenido en python-setuptools 1:68.0.0-1
/usr/lib/python3.11/ está contenido en python-setuptools-rust 1.6.0-1
/usr/lib/python3.11/ está contenido en python-setuptools-scm 7.1.0-4.1
/usr/lib/python3.11/ está contenido en python-six 1.16.0-8.1
/usr/lib/python3.11/ está contenido en python-sniffio 1.3.0-3
/usr/lib/python3.11/ está contenido en python-sortedcontainers 2.4.0-4
/usr/lib/python3.11/ está contenido en python-starlette 0.28.0-1
/usr/lib/python3.11/ está contenido en python-tabulate 0.9.0-2
/usr/lib/python3.11/ está contenido en python-toml 0.10.2-9.1
/usr/lib/python3.11/ está contenido en python-tomli 2.0.1-3.1
/usr/lib/python3.11/ está contenido en python-tomli-w 1.0.0-6.1
/usr/lib/python3.11/ está contenido en python-tqdm 4.66.1-1.1
/usr/lib/python3.11/ está contenido en python-trio 0.22.2-1
/usr/lib/python3.11/ está contenido en python-trove-classifiers 2023.8.7-1.0
/usr/lib/python3.11/ está contenido en python-typing_extensions 4.7.1-1.0
/usr/lib/python3.11/ está contenido en python-urllib3 1.26.15-1.0
/usr/lib/python3.11/ está contenido en python-uvloop 0.17.0-2
/usr/lib/python3.11/ está contenido en python-validate-pyproject 0.13-1.0
/usr/lib/python3.11/ está contenido en python-wcag-contrast-ratio 0.9-4.1
/usr/lib/python3.11/ está contenido en python-websocket-client 1.6.1-1
/usr/lib/python3.11/ está contenido en python-websockets 10.4-3.1
/usr/lib/python3.11/ está contenido en python-wheel 0.40.0-3.2
/usr/lib/python3.11/ está contenido en python-wrapt 1.14.1-2
/usr/lib/python3.11/ está contenido en python-zipp 3.16.2-1.0
/usr/lib/python3.11/ está contenido en scons 4.5.2-1.0
/usr/lib/python3.11/ está contenido en talloc 2.4.1-1.0
/usr/lib/python3.11/ está contenido en tdb 1.4.9-1.0
/usr/lib/python3.11/ está contenido en tevent 1:0.15.0-1.0
/usr/lib/python3.11/ está contenido en util-linux-libs 2.39.1-1.0
/usr/lib/python3.11/ está contenido en uvicorn 0.23.2-1
/usr/lib/python3.11/ está contenido en xcb-proto 1.15.2-3.0

good clean (build from zero) some need packages bootstraped, other old cpython version (cpython0 in main arch)

builded with makepkg -As --skippgpcheck --nocheck and some pkgbuild tweaks, avoid sphynx documentation in all cases