Puppeteer Timeout #267
Description
Describe the bug
When running scans on some of our larger sites we're running into a timeout issue that is ending scans prematurely. We use the latest puppteer image when running unlighthouse.
script:
- echo "Installing NPM Packages"
- npm install @unlighthouse/cli googleapis csv json2csv
- echo "Puppeteer Version:"
- npx puppeteer --version
- echo "Scanning site"
- PUPPETEER_CACHE_DIR=/home/pptruser/.cache/puppeteer
- BROWSER=($(npx puppeteer browsers list | grep '^chrome@'))
- echo "Using Browser ${BROWSER[-1]}"
- export CHROME_PATH=${BROWSER[-1]}
- echo "Setting User Agent"
- export USER_AGENT="${USER_AGENT}"
- echo "User Agent set to ${USER_AGENT}"
- ./node_modules/.bin/unlighthouse-ci --reporter csvExpanded --site "${SITE_NAME}" --config-file "${SITE_FILE}" --user-agent "${USER_AGENT}"
- echo "Reading UnLighthouse report"
- cat .unlighthouse/ci-result.csv
- echo "Uploading to Google Sheets"
- echo "$GOOGLE_SHEETS_API_CREDENTIALS_JSON" > /tmp/google_sheets_api_credentials.json
- export GOOGLE_APPLICATION_CREDENTIALS=${GOOGLE_SERVICE_ACCOUNT}
- node ./unlighthouse-scandata-upload.js
/builds/a11y/site-evaluation-tools/node_modules/puppeteer-cluster/dist/util.js:69
throw new Error(Timeout hit: ${millis});
^
Error: Timeout hit: 300000
at /builds/a11y/site-evaluation-tools/node_modules/puppeteer-cluster/dist/util.js:69:23
at Generator.next ()
at fulfilled (/builds/a11y/site-evaluation-tools/node_modules/puppeteer-cluster/dist/util.js:5:58)
Node.js v22.14.0
The config we're using:
module.exports = {
puppeteerOptions: {
args: ["--no-sandbox", '--disable-dev-shm-usage'],
concurrency: 1,
},
lighthouseOptions: {
onlyCategories: ['best-practices'],
},
server: {
open: false,
site: 'cms.gov',
scanner: {
include: [
"/",
"/about",
"/foia",
"/about-cms/web-policies-important-links/web-policies/privacy",
"/search/cms",
"/sitemap",
"/accessibility",
"/contact",
"/marketplace/agents-brokers/registration-training",
"/about-cms/work-with-us/careers",
"/medicare/physician-fee-schedule/search/overview",
"/acronyms",
"/*",
],
exclude: [
"/*.pdf",
"/*.asp",
"/*.aspx",
"/sample-pfs-searches",
"/security-guidelines-office-location",
"/status-indicators",
"/blog"
],
// run lighthouse for each URL 1 time(s)
samples: 3,
// use desktop to scan
device: 'desktop',
// enable the throttling mode
throttle: true,
// increase the maximum number of routes - https://unlighthouse.dev/api/config#scannermaxroutes
maxRoutes: 500,
// skip the javascript scan
skipJavascript: false,
// use sitemaps - arrays are possible for specific sites https://unlighthouse.dev/api/config#scannersitemap
sitemap: true,
}
},
debug: true,
};
Reproduction
No response
System / Nuxt Info
.default_template:
image: ghcr.io/puppeteer/puppeteer:latest