Skip to content

Conversation

@meezlung
Copy link
Owner

This PR is a crazy workaround for CRS' Login via Gmail only feature. I said crazy because it's a complicated thing to do in the app now. With this, I am thinking of switching to Javascript extension client, but would still reuse some of my endpoints.

Basically, I set up a Selenium-based browser to open the CRS website in which you can login via UP email. Once you have logged in into CRS, Selenium will harvest cookies of the successful attempt of the login, notify the popup that it has successfully harvested the cookies, then finally feed those cookies into the scraper session. At this point, we're essentially scraping the authenticated version of the site!

Docker, on the other hand, doesn't support Selenium-based browser popup, so Login via Gmail option will now be useless when docker-compose up --build is used. I am hoping CRS would set the username and password again.

For now, I'm gonna find more alternatives.

@meezlung meezlung added the enhancement New feature or request label Jun 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants