Galaxus.ch

[CrazyWolf13]

Hi

Can anyone share some tips I may use to scrape https://galaxus.ch ?

I use a VPN (ProtonVPN) and the following browser url:

ws://localhost:3000?stealth=1&--disable-web-security=true&--netifs-to-ignore=eth0@if33

is there anything else I can do?

It's always failing with:

Error - 403 (Access denied) received

[DevrMichael]

I’d debug in this order:

Try loading the page in a normal browser from the same IP. Do you get 403? If yes, IP is the problem.

Switch to a Swiss residential proxy (same region as galaxus) and retry.

Use a non-headless browser or a stealth plugin (playwright-stealth / puppeteer-extra-plugin-stealth). Remove obvious flags like --disable-web-security.

Replicate real browser headers, accept cookies, run the page’s JS (many protections check for JS).

If a WAF/CAPTCHA is in front, you’ll see additional challenges. solving those requires CAPTCHA solving or a session captured from a real browser.

Summary: IP + fingerprinting are the usual culprits.

[CrazyWolf13]

@DevrMichael Thanks a lot for this info!

I use a swiss Residental VPN (ProtonVPN) where access works just fine.

How would I go about installing such a stealth plugin? Could you point me to any help/wiki/docs?

Replicate real browser headers, accept cookies, run the page’s JS (many protections check for JS).

And how is this achievable?

[DevrMichael]

Hey! Since your IP works in normal Chrome, the next step is adding a stealth layer and keeping a real-looking browser profile. Rather than a big brain dump, here are bite-sized docs:

Playwright

• playwright-extra (stealth wrapper): https://github.com/berstend/puppeteer-extra/tree/master/packages/playwright-extra
• Launch persistent context (keep cookies/session): https://playwright.dev/docs/api/class-browsertype#browsertype-launch-persistent-context
• Use real Chrome via channel: https://playwright.dev/docs/browsers#google-chrome--microsoft-edge
• Emulate locale/timezone/geolocation: https://playwright.dev/docs/emulation
• Set extra HTTP headers: https://playwright.dev/docs/api/class-browsercontext#browser-context-set-extra-http-headers
• Persist authentication state: https://playwright.dev/docs/auth#persist-authentication-state

Puppeteer

• puppeteer-extra (plugin framework): https://github.com/berstend/puppeteer-extra
• puppeteer-extra-plugin-stealth: https://github.com/berstend/puppeteer-extra/tree/master/packages/puppeteer-extra-plugin-stealth
• Set extra HTTP headers: https://pptr.dev/api/puppeteer.page.setextrahttpheaders

Useful references

• MDN: Client Hints (Sec-CH-UA, etc.): https://developer.mozilla.org/docs/Web/HTTP/Client_hints
• MDN: Accept-Language: https://developer.mozilla.org/docs/Web/HTTP/Headers/Accept-Language
• Playwright locators (cookie banners): https://playwright.dev/docs/locators

Quick tip: avoid flags like --disable-web-security, start non‑headless while setting things up, and match CH locale/timezone. If you share whether you’re on Playwright or Puppeteer, I can point to a minimal starter.

[CrazyWolf13]

Thank you!

I'm on playwright / Browserless:

https://raw.githubusercontent.com/community-scripts/ProxmoxVE/main/install/changedetection-install.sh

[CrazyWolf13]

How would I go about configuring browsleress/playwright?

SO far I've only been able to use the url arguments inside changedetection, but many of your linked options seem to include cusotm JS?