Local Provider IndeedScraperUKEng Gives 0 Results #176
Unanswered
talal-ahmad-ecio
asked this question in
Q&A
Replies: 1 comment
-
One trick/thing to check is that if you open that URL you aren't getting stuck with a cloudflare page. If you are, unfortunately it's because they've tightened up their scraping protections a fair bit. Sometimes you can fill out the captcha and continue on, but I have to admit that this tool has been outpaced a bit lately. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I selected UK_ENGLISH locale and set the state to England and city to London with all the other settings same as demo settings_USA.yaml and this is the result I got:
[2025-05-07 12:06:50,646] [INFO] JobFunnel: Scraping local providers with: ['IndeedScraperUKEng'] [2025-05-07 12:07:05,932] [ERROR] JobFunnel: Failed to scrape jobs for IndeedScraperUKEng: Unable to extract jobs from initial search result page: Unable to identify number of pages of results for query: https://www.indeed.co.uk/jobs?q=Cloud+Devops&l=london&radius=25&limit=20&filter=0 Please ensure linked page contains results, you may have provided a city for which there are no results within this province or state. [2025-05-07 12:07:05,933] [INFO] JobFunnel: Completed all scraping, found 0 new jobs. [2025-05-07 12:07:05,944] [INFO] JobFunnel: Done. View your current jobs in exports/JobFunnel/jobs/search_usa.csv JobFunnel scraping completed
The issue is that when searching for jobs on indeed uk website I found many job listings with the same filters as the one's in in yaml settings.
Is there anything I'm missing, if so please do let me know. I'll really appreciate the help. Thanks in advance.
Beta Was this translation helpful? Give feedback.
All reactions