Using "Browser Steps" causes "Watches" to have an exception (on Swedish Websites)

[MrChunks]

Describe the bug
I am based in the EU, and I have annoying "cookie warnings" that I am trying to bypass. The "Browser Steps" function appears to work initially, to click away the dialog box. However the processing fails with an exception (but only AFTER I set up the Browser Steps part). I have tested this on two different Swedish retailer websites - changedetection works fine until I setup the cookie "accept" process.

Version
v0.48.05

How did you install?
Installed via Docker on Unraid (Linux (Slack) based OS)
https://github.com/linuxserver/docker-changedetection.io

To Reproduce

Steps to reproduce the behavior:
Create a new watch for, example: https://trade.telia.se/foretag#/buyable/BU4344
2. Click on 'Edit' and go to the "Browser Steps" tab
3. Press "Start" and wait for the page to load.
4. Click on the button that says "Godkänn och spara" (translates to: accept and save) (you can also set the second action to "Click Element" with the xPath "/html/body/div[3]/div/div/div[2]/div/div/div/div/div[2]/button[1]" )
5. Press Save
6. The next time the site is refreshed, you will get an error:

Shared Watch: https://changedetection.io/share/rdHvTpsZJooa

Expected behavior
I am hoping for a simple page change notification, without a stupid "Accept Cookies" popup blocking half the content.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):
Nothing is running on a desktop - it's on a linux server. I am configuring the UI from:

• OS: Windows 11
• Browser: Tested both Firefox 133.0.3 and Chrome 131.0.6778.264

Smartphone (please complete the following information):
N/A

Additional context
I have tried 3 websites now, all Swedish. The error messages all refer to ascii encoding of what looks like Swedish characters:
Adding a Watch to the website "https://www.blocket.se" fails with:
Exception: 'ascii' codec can't encode character '\xe4' in position 18443: ordinal not in range(128)
Adding a Watch to the website "https://trade.telia.se/foretag#/buyable/BU4344" fails with:
Exception: 'ascii' codec can't encode character '\xf6' in position 241: ordinal not in range(128)

Errors from the console:
2025-01-09 22:51:11.576 | DEBUG | changedetectionio.content_fetchers.base:iterate_browser_steps:143 - >> Iterating check - browser Step n 1 - Click element... 2025-01-09 22:51:11.797 | DEBUG | changedetectionio.content_fetchers.playwright:screenshot_step:66 - Saving step screenshot to /config/c996b79f-3175-45da-9e2f-d529ca2e2f51/step_before-1.jpeg 2025-01-09 22:51:11.808 | DEBUG | changedetectionio.content_fetchers.playwright:save_step_html:74 - Saving step HTML to /config/c996b79f-3175-45da-9e2f-d529ca2e2f51/step_before-1.html 2025-01-09 22:51:11.818 | ERROR | changedetectionio.update_worker:run:491 - Exception reached processing watch UUID: c996b79f-3175-45da-9e2f-d529ca2e2f51 2025-01-09 22:51:11.818 | ERROR | changedetectionio.update_worker:run:492 - 'ascii' codec can't encode character '\xf6' in position 241: ordinal not in range(128) 2025-01-09 22:51:11.818 | DEBUG | changedetectionio.update_worker:run:592 - Watch c996b79f-3175-45da-9e2f-d529ca2e2f51 done in 11.25s

The HTML file referred to above exists, but is empty (0kb)

Both of these characters are normal Swedish characters ( öåä / ÖÅÄ ):
https://www.codetable.net/hex/e4
https://www.codetable.net/hex/f6

I think maybe the Browser Steps function just doesn't handle unicode currently.

[dgtlmoon]

And this happens ONLY in browser-steps mode, when using the 'visual selector' its OK?

[MrChunks]

That one seems to work fine.
https://changedetection.io/share/x8QSYiF5D-Ua

[dgtlmoon]

Works fine... (this is on our hosted accounts), are you using selenium or are you using the sockpuppetbrowser?

I think maybe the Browser Steps function just doesn't handle unicode currently.

I'm using browser-steps on hundreds of unicode websites in czech, bulgarian, korean etc websites.. no problems

[MrChunks]

Before you asked that question, and I started investigating, I didn't know what either of those are. So this is likely an ignorant user issue (me).

I have set up a Browserless v2 docker, and subsquently used the following variable to the changedetection docker:
PLAYWRIGHT_DRIVER_URL=ws://<yourIP>:<yourPORT>/chromium?token=yourtoken&launch={"defaultViewport":{"height":1080,"width":1920},"headless":false,"stealth":true}&blockAds=true
You can see the result here:

Should I be using a different argument to the changedetection docker? Should it be "WEBDRIVER_URL" like the screenshot says?

Did I answer your question or no?

[dgtlmoon]

Hmm browserless is not supported anymore, please see the supported configuration https://github.com/dgtlmoon/changedetection.io/blob/master/docker-compose.yml

[dgtlmoon]

Dropping it into discussions for now until we find out whats going on :)