Skip to content

[Bug] HTTP Error 403: rate limit exceeded when compiling 8.0.0 #2188

New issue
New issue
Closed
Closed
[Bug] HTTP Error 403: rate limit exceeded when compiling 8.0.0#2188
Labels
bugSomething isn't workingduplicateThis issue or pull request already exists
Milestone
8.0.1
@okanisis

Description

@okanisis
okanisis
opened on Feb 11, 2022

Describe the bug
Lots of errors in module output and fails to compile GRASS 8.0.0. RC1 and RC2 compiled fine previously.

GRASS GIS 8.0.0 exported compilation log
--------------------------------------------------
Started compilation: Thu 10 Feb 2022 07:19:33 PM MST
--
Errors in:
/tmp/makepkg/grass/src/grass-8.0.0/lib/vector
/tmp/makepkg/grass/src/grass-8.0.0/lib/imagery
/tmp/makepkg/grass/src/grass-8.0.0/lib/cluster
/tmp/makepkg/grass/src/grass-8.0.0/lib/rst/interp_float
/tmp/makepkg/grass/src/grass-8.0.0/lib/lidar
/tmp/makepkg/grass/src/grass-8.0.0/lib/raster3d/test
/tmp/makepkg/grass/src/grass-8.0.0/lib/ogsf
/tmp/makepkg/grass/src/grass-8.0.0/lib/nviz
/tmp/makepkg/grass/src/grass-8.0.0/lib/manage
/tmp/makepkg/grass/src/grass-8.0.0/python/libgrass_interface_generator
/tmp/makepkg/grass/src/grass-8.0.0/db
/tmp/makepkg/grass/src/grass-8.0.0/display
/tmp/makepkg/grass/src/grass-8.0.0/general/g.access
/tmp/makepkg/grass/src/grass-8.0.0/general/g.cairocomp
/tmp/makepkg/grass/src/grass-8.0.0/general/g.copy
/tmp/makepkg/grass/src/grass-8.0.0/general/g.dirseps
/tmp/makepkg/grass/src/grass-8.0.0/general/g.filename
/tmp/makepkg/grass/src/grass-8.0.0/general/g.findetc
/tmp/makepkg/grass/src/grass-8.0.0/general/g.findfile
/tmp/makepkg/grass/src/grass-8.0.0/general/g.gisenv
/tmp/makepkg/grass/src/grass-8.0.0/general/g.gui
/tmp/makepkg/grass/src/grass-8.0.0/general/g.list
/tmp/makepkg/grass/src/grass-8.0.0/general/g.mapset
/tmp/makepkg/grass/src/grass-8.0.0/general/g.mapsets
/tmp/makepkg/grass/src/grass-8.0.0/general/g.message
/tmp/makepkg/grass/src/grass-8.0.0/general/g.mkfontcap
/tmp/makepkg/grass/src/grass-8.0.0/general/g.parser
/tmp/makepkg/grass/src/grass-8.0.0/general/g.pnmcomp
/tmp/makepkg/grass/src/grass-8.0.0/general/g.ppmtopng
/tmp/makepkg/grass/src/grass-8.0.0/general/g.proj
/tmp/makepkg/grass/src/grass-8.0.0/general/g.region
/tmp/makepkg/grass/src/grass-8.0.0/general/g.remove
/tmp/makepkg/grass/src/grass-8.0.0/general/g.rename
/tmp/makepkg/grass/src/grass-8.0.0/general/g.tempfile
/tmp/makepkg/grass/src/grass-8.0.0/general/g.version
/tmp/makepkg/grass/src/grass-8.0.0/general/manage/lister
/tmp/makepkg/grass/src/grass-8.0.0/raster
/tmp/makepkg/grass/src/grass-8.0.0/raster3d
/tmp/makepkg/grass/src/grass-8.0.0/vector
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.cogo
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.measure
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.nviz.image
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.nviz.script
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.transform
/tmp/makepkg/grass/src/grass-8.0.0/imagery
/tmp/makepkg/grass/src/grass-8.0.0/ps/ps.map
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.correlate
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.frame
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.out.file
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.to.rast
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.polar
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.rast.edit
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.rast.leg
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.redraw
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.shade
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.what.rast
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.what.vect
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.dropcolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.droptable
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.in.ogr
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.out.ogr
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.test
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.univar
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.download.location
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.extension
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.extension.all
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.manual
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.search.modules
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.band.library
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.colors.enhance
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.image.mosaic
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.in.spotvgt
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.oif
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.pansharpen
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.spectral
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.tasscap
/tmp/makepkg/grass/src/grass-8.0.0/scripts/m.proj
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.blend
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.buffer.lowmem
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.colors.stddev
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.drain
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.fillnulls
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.grow
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.import
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.in.aster
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.in.srtm
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.in.wms
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.mapcalc.simple
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.mask
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.out.xyz
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.pack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.plane
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.reclass.area
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.rgb
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.semantic.label
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.shade
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.tileset
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.unpack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r3.in.xyz
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.build.all
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.centroids
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.clip
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.addcolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.addtable
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.join
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.dropcolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.droprow
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.droptable
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.renamecolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.reconnect.all
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.univar
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.update
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.dissolve
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.import
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.e00
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.geonames
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.mapgen
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.wfs
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.rast.stats
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.report
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.pack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.to.lines
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.unpack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.what.strds
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.what.vect
/tmp/makepkg/grass/src/grass-8.0.0/temporal
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/docs
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/animation
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/datacatalog
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/mapswipe
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/gmodeler
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/rlisetup
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/psmap
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/dbmgr
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/vdigit
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/rdigit
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/iclass
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/gcp
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/timeline
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/tplot
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/photo2image
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/image2target

and further up it has a lot of:

r.in.gdal: Unable to fetch interface description for command '<r.in.gdal>'.

Details: <[Errno 2] No such file or directory: 'r.in.gdal'>
r.in.xyz: Unable to fetch interface description for command '<r.in.xyz>'.

Details: <[Errno 2] No such file or directory: 'r.in.xyz'>
r.in.ascii: Unable to fetch interface description for command '<r.in.ascii>'.

Details: <[Errno 2] No such file or directory: 'r.in.ascii'>
...

and also contains a lot of:

make -C v.in.lines || echo /tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines >> /tmp/makepkg/grass/src/grass-8.0.0/error.log
make[3]: Entering directory '/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines'
/usr/bin/install -c  v.in.lines.py /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts/v.in.lines
if [ "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts/v.in.lines" != "" ] ; then GISRC=/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/demolocation/.grassrc80 GISBASE=/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu PATH="/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts:$PATH" PYTHONPATH="/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/etc/python:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/gui/wxpython:$PYTHONPATH" LD_LIBRARY_PATH="/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/lib:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/lib:.::/jre/lib" LC_ALL=C LANG=C LANGUAGE=C /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts/v.in.lines --html-description < /dev/null | grep -v '</body>\|</html>' > v.in.lines.tmp.html ; fi
VERSION_NUMBER=8.0.0 VERSION_DATE=2022 MODULE_TOPDIR=../.. \
        python3 /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py v.in.lines > /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/docs/html/v.in.lines.html
Traceback (most recent call last):
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 141, in download_git_commit
    response = urlopen(url, *args, **kwargs)
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 113, in urlopen
    return urlrequest.urlopen(request, *args, **kwargs)
  File "/usr/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: rate limit exceeded

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 658, in <module>
    git_commit = get_last_git_commit(
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 232, in get_last_git_commit
    response = download_git_commit(
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 168, in download_git_commit
    gs.warning(
AttributeError: 'NoneType' object has no attribute 'warning'
make[3]: *** [../../include/Make/Html.make:7: /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/docs/html/v.in.lines.html] Error 1
rm v.in.lines.tmp.html
make[3]: Leaving directory '/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines'

To Reproduce
Steps to reproduce the behavior:

Compile from PKGBUILD using makepkg:

# Maintainer: saultdon <sault.don at gmail>
# Contributor: Sylvain POULAIN <sylvain dot poulain at giscan dot com>
# Contributor: Doug Newgard <scimmia at archlinux dot org>
# Contributor: Maciej Sieczka <msieczka at sieczka dot org>

pkgname=grass
pkgver=8.0.0
pkgrel=1
#_shortver=${pkgver%.*}; _shortver=${_shortver/./}
pkgdesc='Geospatial data management and analysis, image processing, graphics/maps production, spatial modeling and visualization'
arch=('i686' 'x86_64')
url='http://grass.osgeo.org/'
license=('GPL')
depends=('bzip2' 'cairo' 'fftw' 'fontconfig' 'freetype2' 'gcc-libs' 'gdal' 'geos' 'glibc' 'glu'
         'libpng' 'libtiff' 'libx11' 'libgl' 'netcdf' 'proj' 'python-gdal' 'python-numpy'
         'python-pillow' 'python-wxpython' 'readline' 'zlib' 'zstd')
makedepends=('libxt' 'opencl-headers')
optdepends=('postgresql: PostgreSQL database interface'
            'sqlite: SQLite database interface'
            'openmpi: openmp support')
source=("https://github.com/OSGeo/${pkgname}/archive/refs/tags/${pkgver}.tar.gz")
md5sums=('cb79d510eddbf93719f78b1e7202e1c1')
options=('!makeflags')

build() {
  cd $pkgname-$pkgver

  # Ancient autoconf used upstream can't handle CPPFLAGS correctly, so set CPP to ignore warnings
  CPP="gcc -E -w" \
  ./configure \
    --prefix=/opt/$pkgname \
    --with-freetype-includes=/usr/include/freetype2 \
    --with-wxwidgets \
    --with-readline \
    --with-pthread \
    --with-netcdf \
    --with-nls \
    --with-geos \
    --with-postgres \
    --with-bzlib \
    --with-zstd \
    --with-opencl \
    --with-openmp

  make
}

package() {
  cd $pkgname-$pkgver

  make exec_prefix="$pkgdir/usr" INST_DIR="$pkgdir/opt/$pkgname" install

  # Install linker config file, needed for qgis to find grass
  install -d "$pkgdir/etc/ld.so.conf.d/"
  echo "/opt/$pkgname/lib" > "$pkgdir/etc/ld.so.conf.d/$pkgname.conf"

  cd "$pkgdir/opt/$pkgname"

  # Put freedesktop.org files in correct location
  mv share "$pkgdir/usr"

  # Fix some paths that get hard coded by make install
  sed -i "s|$pkgdir||g" demolocation/.grassrc$_shortver \
                        include/Make/{Platform,Grass}.make \
                        etc/fontcap \
                        "$pkgdir/usr/bin/grass"
}

Expected behavior
Successfully compile like RC1 and RC2 and spit out those binaries, libs and scripts =)

System description (please complete the following information):

  • Operating System: Arch Linux

  • uname -a Linux archasus 5.16.8-arch1-1 #1 SMP PREEMPT Tue, 08 Feb 2022 21:21:08 +0000 x86_64 GNU/Linux

  • GRASS GIS version 8.0.0

  • details about further software components

python3 -c "import sys, wx; print(sys.version); print(wx.version())"
3.10.2 (main, Jan 15 2022, 19:56:27) [GCC 11.1.0]
4.1.1 gtk3 (phoenix) wxWidgets 3.1.5

Additional context
If I cd into /tmp/makepkg/grass/src/grass-8.0.0/lib/vector or /tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines and use make it works without error.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingduplicateThis issue or pull request already exists

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions