Firefox fails to build due to missing python module #338
Comments
|
@MastaG what is |
|
@kraj unfortunately bitbake -e firefox doesn't expose PYTHONPATH or PYTHONHOME. So I can assume it's using python3 from my host? De compile log does say: 0:11.08 Consider setting $PYTHONHOME to [:<exec_prefix>] Could it be that it's unset by default? |
|
interesting, I wonder if its defaulting to modules from python that yocto builds and python binary from host then it might be an issue where yocto python3-native might not be building site module. |
|
I'm seeing a similar error in building Firefox: And prior to that in the logs, the Python error: |
|
I can't reproduce it.
In addition, please show me |
ashie
changed the title
|
@ashie Build is on Manjaro - kernel 4.19.88-1. All my recipes are from the Yocto zeus branch. From config.status: And bblayers.conf: |
Hmm, it's almost same with mine. |
It's interesting, I've heard for the first time at this time. |
|
@ashie No issues importing "site" with the Python version in the Firefox build directory or with my host python. Another interesting note, when I run |
|
Confirmed the issue in Manjaro and in Ubuntu:16.04 Docker image with x86 Target. |
|
One aspect to explore would be to see how python2 is built on host as well as python-native on yocto perhaps try to run following program with |
|
From within the docker container: Python seems to have no problem importing |
|
and what do you get when you run python2 from sysroot-native that yocto built ? |
|
@kraj If you're referring to the python2 at |
|
@dswalla yes thats the problem. Yocto compiles its own version of python2 and it seems to be using modules from host, and they wont work reliably if the pythons are not compiled with same settings/features in this case we can see that your host python2 is compiled with 32bit encoding support but yocto version is compiled with 16-bit encoding support for unicode. |
|
Interesting. Is there a portion of the Firefox build script that overrides the python modules path? Running the python2-native executable and checking the path produces the following: |
|
@kraj with the latest openembedded-core, meta-openembedded and meta-python2 it seems to build now (still building so I'm not sure whether it will finish successfully), EDIT: 4:06.22 Compiling audioipc v0.2.4 (/home/mastag/src/odroid-oe-core/build/tmp/work/cortexa15t2hf-neon-vfpv4-oe-linux-gnueabi/firefox/68.0esr-r0/firefox-68.0/media/audioipc/audioipc) So I guess the python problems are solved when using upstream version of bitbake, openembedded-core, meta-openembedded and meta-python2. |
|
Small update, the python problem seems to persist. PREFERRED_VERSION_rust-native ?= "1.37.0" Even when adding DEPENDS += "python-native" it seems to error out with the same message as my opening post: 2:02.38 Could not find platform independent libraries When I run the native python I can import site without problems:
|
The fix for this is available here: I've already backported it to meta-browser in: For python2 issue in dunfell, even using pythonnative didn't work for me, only adding python to HOSTTOOLS worked for me on Ubuntu 20.04, I've added my WIP changes to: |
|
@shr-project I do guess that you are using zeus YPRR ? If yes, you would use gcc 9.x ? |
|
@lmajewski no zeus, I'm using dunfell as mentioned with python2. So I'm using gcc 10.1. For zeus it builds fine (with older meta-rust 5d1ada0c97723e1526bf5599b2fa2cbb56c2c0dc) |
…esults built with dunfell * whole builds aren't ready yet, because there are still some issues while building firefox with dunfell OSSystems/meta-browser#338 * see dunfell branch for explanation why I'm adding this Signed-off-by: Martin Jansa <[email protected]>
I've confirmed it with dunfell & meta-python2.
and
|
|
arent we using |
We currently aren't and adding it doesn't work. |
|
As @shr-project mentioned adding |
Ah, I got it. meta-python2/classes/pythonnative.bbclass provides it. |
It's still failing with the following error: It should be |
|
It probably should be recipe-sysroot-native, because even if you add target python to resolve this issue it will try to use the target library from there and fail on host as shown in top 2 commits of https://github.com/shr-project/meta-browser/commits/jansa/python |
|
meta-python2/classes/pythonnative.bbclass: Probably it should be like this The former one cannot run python-config but the later one can do it. |
|
But I still got another error: It points system's one |
|
@shr-project @ashie Do you have any idea how this issue could be fixed? With newest
I've tried to:
Unfortunately, I still see this error (on Centos 7/Fedora 31). What is strange it works (and compiles on Ubuntu 16.04 and Debian). A side question: |
|
Workaround for mentioned in this thread problem with firefox_68esr build:
And servo in its
This workaround works for centos 7.6 and Ubuntu 18.04. |
|
Could you prepare a PR fixing this so we can go over a review? |
… 68esr is built This is a hack for allow building the firefox 68esr on Centos/Fedora. Detailed description of the problem: OSSystems#338 Signed-off-by: Lukasz Majewski <[email protected]>
|
I've retried this issue with these patches (I'm trying to fix this issue without for meta-python2: diff --git a/classes/pythonnative.bbclass b/classes/pythonnative.bbclass
index 0e9019d..ce30636 100644
--- a/classes/pythonnative.bbclass
+++ b/classes/pythonnative.bbclass
@@ -9,8 +9,8 @@ DEPENDS_append = " python-native "
# python-config and other scripts are using distutils modules
# which we patch to access these variables
-export STAGING_INCDIR
-export STAGING_LIBDIR
+export STAGING_INCDIR="${STAGING_INCDIR_NATIVE}"
+export STAGING_LIBDIR="${STAGING_LIBDIR_NATIVE}"
# Packages can use
# find_package(PythonInterp REQUIRED)for meta-browser: iff --git a/classes/mozilla.bbclass b/classes/mozilla.bbclass
index 4fcb61d..e9ad612 100644
--- a/classes/mozilla.bbclass
+++ b/classes/mozilla.bbclass
@@ -1,9 +1,9 @@
SECTION = "x11/utils"
-DEPENDS += "gnu-config-native virtual/libintl libxt libxi zip-native gtk+"
+DEPENDS += "gnu-config-native virtual/libintl libxt libxi zip-native gtk+ python-native"
SRC_URI += "file://mozconfig"
-inherit pkgconfig
+inherit pkgconfig pythonnative
EXTRA_OECONF = "--target=${TARGET_SYS} --host=${BUILD_SYS} \
--with-toolchain-prefix=${TARGET_SYS}- \Now I've got the following error: Original Python doesn't have It means that system's python is used instead of meta-python2's one. But when I compared both meta-python2's binary and virutualenv's one, their checksum is same (and different with the system's one). On the other hand, virtualenv's one is linked with system's libpython So I doubted & checked rpath in the python binary: Probably this is the cause of this issue. But currently I have no I idea how to fix it. |
…r is built This hack/workaround allows building the firefox 68esr on Centos/Fedora. Detailed description of the problem: OSSystems#338 Firefox's bugzilla entry: https://bugzilla.mozilla.org/show_bug.cgi?id=1651641 Signed-off-by: Lukasz Majewski <[email protected]>
Even I passed the issue by modifying rpath (or adding It doesn't occur when I use Hmm, using pythonnative is hard ;-( |
|
This is strange for me - HOSTTOOLS=python2.7 doesn't work for me on Centos/Fedora and Thud. However, I can build firefox 68esr on Thud (2.6) without setting anything (HOSTTOOLS and other hacks) on Debian10 and Ubuntu 18.04 (which are recommended for this YPRR). |
…r is built This hack/workaround allows building the firefox 68esr on Centos/Fedora. Detailed description of the problem: OSSystems#338 Firefox's bugzilla entry: https://bugzilla.mozilla.org/show_bug.cgi?id=1651641 Signed-off-by: Lukasz Majewski <[email protected]>
…r is built This hack/workaround allows building the firefox 68esr on Centos/Fedora. Detailed description of the problem: #338 Firefox's bugzilla entry: https://bugzilla.mozilla.org/show_bug.cgi?id=1651641 Signed-off-by: Lukasz Majewski <[email protected]>
…r is built This hack/workaround allows building the firefox 68esr on Centos/Fedora. Detailed description of the problem: #338 Firefox's bugzilla entry: https://bugzilla.mozilla.org/show_bug.cgi?id=1651641 Signed-off-by: Lukasz Majewski <[email protected]>
…r is built This hack/workaround allows building the firefox 68esr on Centos/Fedora. Detailed description of the problem: OSSystems#338 Firefox's bugzilla entry: https://bugzilla.mozilla.org/show_bug.cgi?id=1651641 Signed-off-by: Lukasz Majewski <[email protected]>
Hi I'm a bit new to firefox/rust, but it fails to build for armv7.
It seems to be missing some python module "site" ?
Any ideas?
The text was updated successfully, but these errors were encountered: