smodels v3.0.x PyPI distributions are broken

[matthewfeickert]

The current distribution on PyPI is broken as it fails to install with both pip and uv. From the error messages it seems that smodels isn't being packaged correctly.

Reproducer with pip

$ docker run --rm -ti python:3.12 bash
root@c118f93e5e26:/# python -m venv venv && . venv/bin/activate
(venv) root@c118f93e5e26:/# python -m pip install --upgrade pip
(venv) root@c118f93e5e26:/# python -m pip install smodels
...
      ModuleNotFoundError: No module named 'smodels.tools.smodelsLogging'
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for smodels

pip_full_log.txt

Reproducer with uv

$ docker run --rm -ti python:3.12 bash
root@c118f93e5e26:/# python -m venv venv && . venv/bin/activate
(venv) root@c118f93e5e26:/# python -m pip install --upgrade uv
(venv) root@c118f93e5e26:/# uv pip install smodels
...
          from smodels.tools.smodelsLogging import logger
      ModuleNotFoundError: No module named 'smodels.tools.smodelsLogging'

      hint: This usually indicates a problem with the package or the build environment.

uv_full_log.txt

[matthewfeickert]

From forcing builds in other ways I also see that there's further packaging issues with smodels.tools.printers.

+ runSModelS.py --help
Traceback (most recent call last):
  File "/home/conda/staged-recipes/build_artifacts/smodels_1740423117258/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/bin/runSModelS.py", line 7, in <module>
    from smodels.tools.runSModelS import main
  File "/home/conda/staged-recipes/build_artifacts/smodels_1740423117258/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.10/site-packages/smodels/tools/runSModelS.py", line 13, in <module>
    from smodels.matching import modelTester
  File "/home/conda/staged-recipes/build_artifacts/smodels_1740423117258/_test_env_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehold_placehol/lib/python3.10/site-packages/smodels/matching/modelTester.py", line 26, in <module>
    from smodels.tools.printers.masterPrinter import MPrinter
ModuleNotFoundError: No module named 'smodels.tools.printers'

[matthewfeickert]

All the v3.0.X releases are broken, but v2.3.3 installs with

uv pip install 'smodels<3.0.0'

so things broke somewhere between v2.3.3 and v3.0.0.

[WolfgangWaltenberger]

Ha, indeed leftovers from refactoring between v2 and v3, thanks for spotting and pointing out!

[matthewfeickert]

Ha, indeed leftovers from refactoring between v2 and v3, thanks for spotting and pointing out!

If you ping me when you merge in the fix patches we can patch the conda-forge builds so that those are not broken. (c.f. #45)

[WolfgangWaltenberger]

Hm, pyproject.toml seems to interfere with "the old way":

snunmu:~> pip install -i https://test.pypi.org/simple/ smodels==3.0.3rc1
Looking in indexes: https://test.pypi.org/simple/
Collecting smodels==3.0.3rc1
Using cached https://test-files.pythonhosted.org/packages/37/2c/9050155f323a0cc1b1ea33026cbed537d6918a4bb1fd9ebfc1191a6d61ca/smodels-3.0.3rc1.tar.gz (1.9 MB)
Installing build dependencies ... error
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> [3 lines of output]
Looking in indexes: https://test.pypi.org/simple/
ERROR: Could not find a version that satisfies the requirement setuptools>=61.0 (from versions: none)
ERROR: No matching distribution found for setuptools>=61.0
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

I built with:
rm -rf dist
python3 setup.py sdist bdist_wheel
twine upload -r pypitest dist/smodels-*.tar.gz

Its 11pm here, will continue another time.

Wolfgang

[matthewfeickert]

@WolfgangWaltenberger

I built with:

rm -rf dist
python3 setup.py sdist bdist_wheel
twine upload -r pypitest dist/smodels-*.tar.gz

What Python version did you use? The error is indicating that it can't install setuptools which means you're probably using an ancient Python version as setuptools v61.0 only requires Python 3.7 (which has been EOL for some time).

$ eol python
┌───────┬────────────┬─────────┬────────────────┬────────────┬────────────┐
│ cycle │  release   │ latest  │ latest release │  support   │    eol     │
├───────┼────────────┼─────────┼────────────────┼────────────┼────────────┤
│ 3.13  │ 2024-10-07 │ 3.13.2  │   2025-02-04   │ 2026-10-01 │ 2029-10-31 │
│ 3.12  │ 2023-10-02 │ 3.12.9  │   2025-02-04   │ 2025-04-02 │ 2028-10-31 │
│ 3.11  │ 2022-10-24 │ 3.11.11 │   2024-12-03   │ 2024-04-01 │ 2027-10-31 │
│ 3.10  │ 2021-10-04 │ 3.10.16 │   2024-12-03   │ 2023-04-05 │ 2026-10-31 │
│ 3.9   │ 2020-10-05 │ 3.9.21  │   2024-12-03   │ 2022-05-17 │ 2025-10-31 │
│ 3.8   │ 2019-10-14 │ 3.8.20  │   2024-09-06   │ 2021-05-03 │ 2024-10-07 │
│ 3.7   │ 2018-06-27 │ 3.7.17  │   2023-06-05   │ 2020-06-27 │ 2023-06-27 │
│ 3.6   │ 2016-12-23 │ 3.6.15  │   2021-09-03   │ 2018-12-24 │ 2021-12-23 │
│ 3.5   │ 2015-09-13 │ 3.5.10  │   2020-09-05   │   False    │ 2020-09-30 │
│ 3.4   │ 2014-03-16 │ 3.4.10  │   2019-03-18   │   False    │ 2019-03-18 │
│ 3.3   │ 2012-09-29 │ 3.3.7   │   2017-09-19   │   False    │ 2017-09-29 │
│ 3.2   │ 2011-02-20 │ 3.2.6   │   2014-10-12   │   False    │ 2016-02-20 │
│ 2.7   │ 2010-07-03 │ 2.7.18  │   2020-04-19   │   False    │ 2020-01-01 │
│ 3.1   │ 2009-06-27 │ 3.1.5   │   2012-04-06   │   False    │ 2012-04-09 │
│ 3.0   │ 2008-12-03 │ 3.0.1   │   2009-02-12   │   False    │ 2009-06-27 │
│ 2.6   │ 2008-10-01 │ 2.6.9   │   2013-10-29   │   False    │ 2013-10-29 │
└───────┴────────────┴─────────┴────────────────┴────────────┴────────────┘

Also, please do not use this method. c.f. Paul Ganssle's Why you shouldn't invoke setup.py directly.

Please use

python -m pip install build
rm -rf dist
python -m build .
twine check --strict dist/*

or if you're okay using uv

rm -rf dist
uvx --from build pyproject-build .
uvx twine check --strict dist/*

[WolfgangWaltenberger]

Well thats the weird bit. I am on python 3.12, setuptools 75:

Will investigate. meanwhile i moved from setup.py to pip, but doesnt change that issue.
but it seems like the problem is that there isnt a setuptools registered in test.pypi.org?
also i had assumed that all the pip stuff would still go via setup.py, ignore pyproject.toml. there is still a lot i dont
understand.
Edited: I see pypi -i only uses that index, i have to use --extra-index-url. Am trying again.

wolfgang

[WolfgangWaltenberger]

alright, smodels:develop seems to be working now, bot with pip install und uv pip install:

uv pip install --index-strategy unsafe-best-match --extra-index-url https://test.pypi.org/simple/ smodels==3.0.3rc6

i would ask andre if he is ok with it,
then i could release as 303. is there a way you can test the develop branch, or the rc6 package on testpypi?

[matthewfeickert]

FWIW, things work as expected for me with 3.0.3rc1 with Python 3.12

python -m pip install --index-url https://test.pypi.org/simple/ --extra-index-url https://pypi.org/simple 'smodels==3.0.3rc1'

$ docker run --rm -ti python:3.12 bash
root@bcf4ba7ff198:/# python -m venv venv && . venv/bin/activate
(venv) root@bcf4ba7ff198:/# python -m pip install --index-url https://test.pypi.org/simple/ --extra-index-url https://pypi.org/simple 'smodels==3.0.3rc1'
Looking in indexes: https://test.pypi.org/simple/, https://pypi.org/simple
Collecting smodels==3.0.3rc1
  Downloading https://test-files.pythonhosted.org/packages/37/2c/9050155f323a0cc1b1ea33026cbed537d6918a4bb1fd9ebfc1191a6d61ca/smodels-3.0.3rc1.tar.gz (1.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.9/1.9 MB 22.0 MB/s eta 0:00:00
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting docutils>=0.3 (from smodels==3.0.3rc1)
  Downloading docutils-0.21.2-py3-none-any.whl.metadata (2.8 kB)
Collecting numpy>=1.22.0 (from smodels==3.0.3rc1)
  Downloading numpy-2.2.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (62 kB)
Collecting scipy>=1.0.0 (from smodels==3.0.3rc1)
  Downloading scipy-1.15.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
Collecting sympy>=1.0.0 (from smodels==3.0.3rc1)
  Downloading sympy-1.13.3-py3-none-any.whl.metadata (12 kB)
Collecting unum>=4.0.0 (from smodels==3.0.3rc1)
  Downloading Unum-4.2.1.tar.gz (25 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting requests>=2.0.0 (from smodels==3.0.3rc1)
  Downloading requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting pyslha>=3.1.0 (from smodels==3.0.3rc1)
  Downloading pyslha-3.2.6.tar.gz (41 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting pyhf>=0.6.1 (from smodels==3.0.3rc1)
  Downloading pyhf-0.7.6-py3-none-any.whl.metadata (19 kB)
Collecting jsonpatch>=1.25 (from smodels==3.0.3rc1)
  Downloading jsonpatch-1.33-py2.py3-none-any.whl.metadata (3.0 kB)
Collecting jsonschema>=3.2.0 (from smodels==3.0.3rc1)
  Downloading jsonschema-4.23.0-py3-none-any.whl.metadata (7.9 kB)
Collecting jsonpointer>=1.9 (from jsonpatch>=1.25->smodels==3.0.3rc1)
  Downloading jsonpointer-3.0.0-py2.py3-none-any.whl.metadata (2.3 kB)
Collecting attrs>=22.2.0 (from jsonschema>=3.2.0->smodels==3.0.3rc1)
  Downloading attrs-25.1.0-py3-none-any.whl.metadata (10 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.2.0->smodels==3.0.3rc1)
  Downloading jsonschema_specifications-2024.10.1-py3-none-any.whl.metadata (3.0 kB)
Collecting referencing>=0.28.4 (from jsonschema>=3.2.0->smodels==3.0.3rc1)
  Downloading referencing-0.36.2-py3-none-any.whl.metadata (2.8 kB)
Collecting rpds-py>=0.7.1 (from jsonschema>=3.2.0->smodels==3.0.3rc1)
  Downloading rpds_py-0.23.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)
Collecting click>=8.0.0 (from pyhf>=0.6.1->smodels==3.0.3rc1)
  Downloading click-8.1.8-py3-none-any.whl.metadata (2.3 kB)
Collecting pyyaml>=5.1 (from pyhf>=0.6.1->smodels==3.0.3rc1)
  Downloading PyYAML-6.0.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.1 kB)
Collecting tqdm>=4.56.0 (from pyhf>=0.6.1->smodels==3.0.3rc1)
  Downloading tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
Collecting tex2pix>=0.1.5 (from pyslha>=3.1.0->smodels==3.0.3rc1)
  Downloading tex2pix-0.3.1.tar.gz (5.4 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Collecting charset-normalizer<4,>=2 (from requests>=2.0.0->smodels==3.0.3rc1)
  Downloading charset_normalizer-3.4.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (35 kB)
Collecting idna<4,>=2.5 (from requests>=2.0.0->smodels==3.0.3rc1)
  Downloading idna-3.10-py3-none-any.whl.metadata (10 kB)
Collecting urllib3<3,>=1.21.1 (from requests>=2.0.0->smodels==3.0.3rc1)
  Downloading urllib3-2.3.0-py3-none-any.whl.metadata (6.5 kB)
Collecting certifi>=2017.4.17 (from requests>=2.0.0->smodels==3.0.3rc1)
  Downloading certifi-2025.1.31-py3-none-any.whl.metadata (2.5 kB)
Collecting mpmath<1.4,>=1.1.0 (from sympy>=1.0.0->smodels==3.0.3rc1)
  Downloading mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Collecting typing-extensions>=4.4.0 (from referencing>=0.28.4->jsonschema>=3.2.0->smodels==3.0.3rc1)
  Downloading typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Downloading docutils-0.21.2-py3-none-any.whl (587 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 587.4/587.4 kB 16.3 MB/s eta 0:00:00
Downloading jsonpatch-1.33-py2.py3-none-any.whl (12 kB)
Downloading jsonschema-4.23.0-py3-none-any.whl (88 kB)
Downloading numpy-2.2.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.1/16.1 MB 33.8 MB/s eta 0:00:00
Downloading pyhf-0.7.6-py3-none-any.whl (160 kB)
Downloading requests-2.32.3-py3-none-any.whl (64 kB)
Downloading scipy-1.15.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (37.3 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 37.3/37.3 MB 32.4 MB/s eta 0:00:00
Downloading sympy-1.13.3-py3-none-any.whl (6.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 30.6 MB/s eta 0:00:00
Downloading attrs-25.1.0-py3-none-any.whl (63 kB)
Downloading certifi-2025.1.31-py3-none-any.whl (166 kB)
Downloading charset_normalizer-3.4.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (145 kB)
Downloading click-8.1.8-py3-none-any.whl (98 kB)
Downloading idna-3.10-py3-none-any.whl (70 kB)
Downloading jsonpointer-3.0.0-py2.py3-none-any.whl (7.6 kB)
Downloading jsonschema_specifications-2024.10.1-py3-none-any.whl (18 kB)
Downloading mpmath-1.3.0-py3-none-any.whl (536 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 23.0 MB/s eta 0:00:00
Downloading PyYAML-6.0.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (767 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 767.5/767.5 kB 10.3 MB/s eta 0:00:00
Downloading referencing-0.36.2-py3-none-any.whl (26 kB)
Downloading rpds_py-0.23.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (391 kB)
Downloading tqdm-4.67.1-py3-none-any.whl (78 kB)
Downloading urllib3-2.3.0-py3-none-any.whl (128 kB)
Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Building wheels for collected packages: smodels, pyslha, unum, tex2pix
  Building wheel for smodels (pyproject.toml) ... done
  Created wheel for smodels: filename=smodels-3.0.3rc1-py3-none-any.whl size=3507385 sha256=d5b6ded49e6b7e264728a17adc5fb055053ad3b782939ba5ef6fdc9cad049710
  Stored in directory: /root/.cache/pip/wheels/6d/ff/ee/6450138da60f76ab947a79d6f93138e89d7624ffe933f9e7cc
  Building wheel for pyslha (pyproject.toml) ... done
  Created wheel for pyslha: filename=pyslha-3.2.6-py3-none-any.whl size=30521 sha256=abcd6684a1433e5e1cac5b87d15ebb2fa8ac317162b6f3b00a6ef0c2b04fda9b
  Stored in directory: /root/.cache/pip/wheels/36/d6/10/bc69ffe5881737bc217a7c124a77af9c93fb9f00c1023a915a
  Building wheel for unum (pyproject.toml) ... done
  Created wheel for unum: filename=unum-4.2.1-py2.py3-none-any.whl size=26878 sha256=53ea99f5262cb203bc54a1a8fc81d86f5e1448db5bff05e241df22879e7d846c
  Stored in directory: /root/.cache/pip/wheels/19/35/28/5a8f88d1432cc6dcc6622de08f83483d376c2275394f5827bd
  Building wheel for tex2pix (pyproject.toml) ... done
  Created wheel for tex2pix: filename=tex2pix-0.3.1-py3-none-any.whl size=4984 sha256=733d1db365100280d5b39dba05b9e43f379fa875f700997d8f158a0ce9c7495d
  Stored in directory: /root/.cache/pip/wheels/31/61/95/b95bdfdf5d6eaa79dc072474e8120be36d92a6ca1d68ec41c6
Successfully built smodels pyslha unum tex2pix
Installing collected packages: tex2pix, mpmath, urllib3, unum, typing-extensions, tqdm, sympy, rpds-py, pyyaml, pyslha, numpy, jsonpointer, idna, docutils, click, charset-normalizer, certifi, attrs, scipy, requests, referencing, jsonpatch, jsonschema-specifications, jsonschema, pyhf, smodels
Successfully installed attrs-25.1.0 certifi-2025.1.31 charset-normalizer-3.4.1 click-8.1.8 docutils-0.21.2 idna-3.10 jsonpatch-1.33 jsonpointer-3.0.0 jsonschema-4.23.0 jsonschema-specifications-2024.10.1 mpmath-1.3.0 numpy-2.2.3 pyhf-0.7.6 pyslha-3.2.6 pyyaml-6.0.2 referencing-0.36.2 requests-2.32.3 rpds-py-0.23.1 scipy-1.15.2 smodels-3.0.3rc1 sympy-1.13.3 tex2pix-0.3.1 tqdm-4.67.1 typing-extensions-4.12.2 unum-4.2.1 urllib3-2.3.0
(venv) root@bcf4ba7ff198:/# python -m pip show smodels
Name: smodels
Version: 3.0.3rc1
Summary: A tool for interpreting simplified-model results from the LHC
Home-page: http://smodels.github.io/
Author: The SModelS collaboration, smodels-users@lists.oeaw.ac.at Current members: Mohammad Mahdi Altakach, Sabine Kraml, Andre Lessa, Sahana Narashima, Timothee Pascal, Camila Ramos, Humberto Reyes-Gonzalez, Theo Reymermier, Yoxara Villamizar, Wolfgang Waltenberger  Previously involved in SModelS: Gael Alguero, Federico Ambrogi, Juhi Dutta, Jan Heisig, Charanjit K. Khosa, Suchita Kulkarni, Ursula Laa, Veronika Magerl, Wolfgang Magerl, Philipp Neuhuber, Doris Proschofsky, Jory Sonneveld, Michael Traub, Matthias Wolf, Alicia Wongel
Author-email: smodels-developers@lists.oeaw.ac.at 
License: GPLv3
Location: /venv/lib/python3.12/site-packages
Requires: docutils, jsonpatch, jsonschema, numpy, pyhf, pyslha, requests, scipy, sympy, unum
Required-by: 

note though that I'm setting the --index-url to TestPyPI and then setting --extra-index-url to PyPI so that everything not on TestPyPI still gets picked up. With uv the behavior is reversed. (c.f. scientific-python/upload-nightly-action#76)

uv pip install --index-strategy unsafe-best-match --extra-index-url https://test.pypi.org/simple/ 'smodels==3.0.3rc1'

(which is what you already found to be working 👍)

@WolfgangWaltenberger In your example you were just using pip install. Is it possible that the pip you were using was not the pip associated with your Python runtime? python -m pip is the only pattern (when using pip) that ensures that you get the correct pip for the python you want.

python -m pip install --index-url https://test.pypi.org/simple/ --extra-index-url https://pypi.org/simple 'smodels==3.0.3rc6'

works for me too (no surprise).

is there a way you can test the develop branch,

Sure.

$ python -m pip install --upgrade 'smodels@git+https://github.com/SModelS/smodels.git@develop'
$ python -m pip show smodels
Name: smodels
Version: 3.0.3
Summary: A tool for interpreting simplified-model results from the LHC
Home-page: http://smodels.github.io/
Author: The SModelS collaboration, smodels-users@lists.oeaw.ac.at Current members: Mohammad Mahdi Altakach, Sabine Kraml, Andre Lessa, Sahana Narashima, Timothee Pascal, Camila Ramos, Humberto Reyes-Gonzalez, Theo Reymermier, Yoxara Villamizar, Wolfgang Waltenberger  Previously involved in SModelS: Gael Alguero, Federico Ambrogi, Juhi Dutta, Jan Heisig, Charanjit K. Khosa, Suchita Kulkarni, Ursula Laa, Veronika Magerl, Wolfgang Magerl, Philipp Neuhuber, Doris Proschofsky, Jory Sonneveld, Michael Traub, Matthias Wolf, Alicia Wongel
Author-email: smodels-developers@lists.oeaw.ac.at 
License: GPLv3
Location: /venv/lib/python3.12/site-packages
Requires: docutils, jsonpatch, jsonschema, numpy, pyhf, pyslha, requests, scipy, sympy, unum
Required-by:

[WolfgangWaltenberger]

released 3.0.3: https://smodels.github.io/
hopefully fixing all of the above.

Wolfgang

[matthewfeickert]

released 3.0.3: https://smodels.github.io/ hopefully fixing all of the above.

Great. The changes are rather modest in size, 3.0.2...3.0.3, so these should be easy to backport to fix the conda-forge builds for v3.0.x.

[WolfgangWaltenberger]

you are saying its not sufficient to simply start back with the conda-forge builds with >=303? You want also the previous builds? is that what you are doing now? (how) can i help?

wolfgang