Did anyone manage to build the python client on python 3.13? It tries to build statically and fails. And passing args to b2 is now complicated.

[tuxayo]

Hi :)

I'm trying this: #7333 (comment)

I'm on EndeavourOS with boost and openssl packages which on Arch based distros include the devel stuff.
I have libssl.so and libcrypto.so and the openssl and boost headers in /usr/include.

Should I be using a venv? sudo python3 -m pip install [...] is how in the past I messed /usr/lib with stuff not from repos. Is venv the current way to go in general? Is it compatible with libretorrent build process in particular?

After all, there is no sudo used in #7333 (comment)
So something is done to not install in /

What I did:

python -m venv /home/datumoj/dev/libtorrent/python-venv
cd /home/datumoj/dev/libtorrent/python-venv
source ./bin/activate

After that I did:

(python-venv) /h/d/d/l/python-venv ❯❯❯ time python3 -m pip install --global-option="--b2-args=webtorrent=on" git+https://github.com/arvidn/libtorrent.git@master                               ✘ 130 
DEPRECATION: --build-option and --global-option are deprecated. pip 25.0 will enforce this behaviour change. A possible replacement is to use --config-settings. Discussion can be found at https://github.com/pypa/pip/issues/11859
WARNING: Implying --no-binary=:all: due to the presence of --build-option / --global-option. 
Collecting git+https://github.com/arvidn/libtorrent.git@master
  Cloning https://github.com/arvidn/libtorrent.git (to revision master) to /tmp/pip-req-build-40uheyba
  Running command git clone --filter=blob:none --quiet https://github.com/arvidn/libtorrent.git /tmp/pip-req-build-40uheyba
  Running command git checkout -b master --track origin/master
  Switched to a new branch 'master'
  branch 'master' set up to track 'origin/master'.
  Resolved https://github.com/arvidn/libtorrent.git to commit 9eaa8522cb6da2cb2ae8277d95b183bcfc5adbc9
  Running command git submodule update --init --recursive -q
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Building wheels for collected packages: libtorrent
  WARNING: Ignoring --global-option when building libtorrent using PEP 517
  Building wheel for libtorrent (pyproject.toml) ... error
  error: subprocess-exited-with-error
  
  × Building wheel for libtorrent (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [360 lines of output]
      running bdist_wheel
      b2 version: (1, 5, 2, 1)
      running build
      running build_py
      creating build/lib.linux-x86_64-cpython-313/libtorrent
      copying libtorrent/__init__.pyi -> build/lib.linux-x86_64-cpython-313/libtorrent
      copying libtorrent/py.typed -> build/lib.linux-x86_64-cpython-313/libtorrent
      running build_ext
      project-config.jam contents:
      import feature ;
      feature.feature libtorrent-python : on ;
      using python : 3.13 : "/home/datumoj/dev/libtorrent/python-venv/bin/python3" : "/home/datumoj/dev/libtorrent/python-venv/include" "/usr/include/python3.13" : "/usr/lib" : <libtorrent-python>on : ".cpython-313-x86_64-linux-gnu" ;

      b2 cxxstd=17 deprecated-functions=on boost-link=static libtorrent-link=static crypto=openssl variant=release address-model=64 python=3.13 libtorrent-python=on library-path="/usr/lib" python-install-path=/tmp/pip-req-build-40uheyba/bindings/python/build/lib.linux-x86_64-cpython-313 install_module --project-config=/tmp/tmpiiafh4ch
      OS = LINUX
      CXXFLAGS =
      LDFLAGS =
      warning: No toolsets are configured.
      warning: Configuring default toolset "gcc".
      warning: If the default is wrong, your build may not work correctly.
      warning: Use the "toolset=xxxxx" option to override our guess.
      warning: For more configuration options, please consult
      warning: https://www.bfgroup.xyz/b2/manual/release/index.html#bbv2.overview.configuration
      WARNING: you cannot link statically against boost-python on linux before version 1.74.0, because it links against pthread statically in that case, which is not allowed
      WARNING: you cannot link statically against boost-python on linux before version 1.74.0, because it links against pthread statically in that case, which is not allowed
      warning: non-free usage requirements <visibility>hidden ignored
      warning: in main-target torrent at ../../Jamfile:1029
      ...patience...
      ...found 1834 targets...
      ...updating 235 targets...
      [...............................................]
      gcc.compile.c++ bin/gcc-14/release/address-model-64/cxxstd-17-iso/deprecated-functions-on/libtorrent-python-pic-on/python-3.13/src/module.o
      gcc.link.dll bin/gcc-14/release/address-model-64/cxxstd-17-iso/deprecated-functions-on/libtorrent-python-pic-on/python-3.13/libtorrent.cpython-313-x86_64-linux-gnu.so
      /usr/bin/ld: cannot find -lssl: Dosiero aŭ dosierujo ne ekzistas
      /usr/bin/ld: have you installed the static version of the ssl library ?
      /usr/bin/ld: cannot find -lcrypto: Dosiero aŭ dosierujo ne ekzistas
      /usr/bin/ld: have you installed the static version of the crypto library ?
      collect2: error: ld returned 1 exit status

It tried statically by default. So I'm trying to pass --b2-args=webtorrent=on\ libtorrent-link=shared\ boost-link=shared

But it end up ignored due to pypa/pip#11859 and pypa/setuptools#2491

I tried python3 -m pip install --verbose --config-settings=--global-option=--b2-args=webtorrent=on\ libtorrent-link=shared\ boost-link=shared git+https://github.com/arvidn/libtorrent.git@master

But it leads to

  Successfully installed setuptools-76.0.0
  Installing build dependencies ... done
  Running command Getting requirements to build wheel
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help

  error: option --b2-args not recognized

python3 -m pip install --verbose --no-use-pep517 --global-option="--b2-args=webtorrent=on\ libtorrent-link=shared\ boost-link=shared" git+https://github.com/arvidn/libtorrent.git@master

  9eaa8522cb6da2cb2ae8277d95b183bcfc5adbc9
  Running command python setup.py bdist_wheel
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help

  error: option --b2-args not recognized

python3 -m pip install --verbose --config-settings="--build-option='--b2-args=webtorrent=on\ libtorrent-link=shared\ boost-link=shared'" git+https://github.com/arvidn/libtorrent.git@master

  Running command Building wheel for libtorrent (pyproject.toml)
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help

  error: option --b2-args not recognized

I tried other variations with no better outcome but I'm likely no even digging in the right direction.

[tuxayo]

So even if I can build without the b2 args for linking (it not be how to fix build) I still need to somehow enable webtorrent or any other feature or debug param that someone else would use the python client to troubleshot.

It's really handy to have a minimal client within the lib repo to directly test it without having a complex client on top. For which building might be even more a mess.

[arvidn]

the setup.py is a bit of a black box to me as well. As a hack, you can change the webtorrent feature in the Jamfile to put the on option first. That will enable it by default so you won't need to specify it on the command line.

i.e. change:

feature webtorrent : off on : composite propagated ;

to:

feature webtorrent : on off : composite propagated ;

[arvidn]

Btw, the traditional way of building the python module still works. I find this more reliable:

cd bindings/python
b2 stage_module stage_dependencies
LD_LIBRARY_PATH=./dependencies pytest tests

A python module has to be a shared library, so python can load it. Sometimes on linux you also have to specify fpic=on in the b2 command line.

If you want to link statically against libtorrent and boost, you can add libtorrent-link=static boost-link=static. It's possible openssl will be attempted to be linked statically in that case as well.