Profile scraping not working

[kumashankar-mbai]

C:\Users\User\PycharmProjects\Azure_Auto_login\venv\Scripts\python.exe "C:/Program Files/JetBrains/PyCharm Community Edition 2023.1.3/plugins/python-ce/helpers/pydev/pydevconsole.py" --mode=client --host=127.0.0.1 --port=54582
import sys; print('Python %s on %s' % (sys.version, sys.platform))
sys.path.extend(['C:\Users\User\PycharmProjects\Azure_Auto_login'])
PyDev console: starting.
Python 3.9.13 (tags/v3.9.13:6de2ca5, May 17 2022, 16:36:42) [MSC v.1929 64 bit (AMD64)] on win32
runfile('C:\Users\User\PycharmProjects\Azure_Auto_login\linkedin_scraper_git.py', wdir='C:\Users\User\PycharmProjects\Azure_Auto_login')
Traceback (most recent call last):
File "C:\Program Files\JetBrains\PyCharm Community Edition 2023.1.3\plugins\python-ce\helpers\pydev\pydevconsole.py", line 364, in runcode
coro = func()
File "", line 1, in
File "C:\Program Files\JetBrains\PyCharm Community Edition 2023.1.3\plugins\python-ce\helpers\pydev_pydev_bundle\pydev_umd.py", line 197, in runfile
pydev_imports.execfile(filename, global_vars, local_vars) # execute the script
File "C:\Program Files\JetBrains\PyCharm Community Edition 2023.1.3\plugins\python-ce\helpers\pydev_pydev_imps_pydev_execfile.py", line 18, in execfile
exec(compile(contents+"\n", file, 'exec'), glob, loc)
File "C:\Users\User\PycharmProjects\Azure_Auto_login\linkedin_scraper_git.py", line 8, in
person = Person("https://www.linkedin.com/in/rushabhbmehta/", driver=driver)
File "C:\Users\User\PycharmProjects\Azure_Auto_login\venv\lib\site-packages\linkedin_scraper\person.py", line 64, in init
self.scrape(close_on_complete)
File "C:\Users\User\PycharmProjects\Azure_Auto_login\venv\lib\site-packages\linkedin_scraper\person.py", line 89, in scrape
self.scrape_logged_in(close_on_complete=close_on_complete)
File "C:\Users\User\PycharmProjects\Azure_Auto_login\venv\lib\site-packages\linkedin_scraper\person.py", line 259, in scrape_logged_in
root = WebDriverWait(driver, self.__WAIT_FOR_ELEMENT_TIMEOUT).until(
File "C:\Users\User\PycharmProjects\Azure_Auto_login\venv\lib\site-packages\selenium\webdriver\support\wait.py", line 95, in until
raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message:
Stacktrace:
GetHandleVerifier [0x00007FF7CCB32142+3514994]
(No symbol) [0x00007FF7CC750CE2]
(No symbol) [0x00007FF7CC5F76AA]
(No symbol) [0x00007FF7CC641860]
(No symbol) [0x00007FF7CC64197C]
(No symbol) [0x00007FF7CC684EE7]
(No symbol) [0x00007FF7CC66602F]
(No symbol) [0x00007FF7CC6828F6]
(No symbol) [0x00007FF7CC665D93]
(No symbol) [0x00007FF7CC634BDC]
(No symbol) [0x00007FF7CC635C64]
GetHandleVerifier [0x00007FF7CCB5E16B+3695259]
GetHandleVerifier [0x00007FF7CCBB6737+4057191]
GetHandleVerifier [0x00007FF7CCBAE4E3+4023827]
GetHandleVerifier [0x00007FF7CC8804F9+689705]
(No symbol) [0x00007FF7CC75C048]
(No symbol) [0x00007FF7CC758044]
(No symbol) [0x00007FF7CC7581C9]
(No symbol) [0x00007FF7CC7488C4]
BaseThreadInitThunk [0x00007FFF13DE257D+29]
RtlUserThreadStart [0x00007FFF13F6AA58+40]

I am getting this timeout exception

[mostafamdy]

same error with me Did you solve it?

[C-Nubela]

@mostafamdy @kumashankar-mbai

Hey there! I work for Proxycurl, one of the sponsors for this project, and if you guys are looking for a more convenient way of scraping LinkedIn where you don't have to deal with debugging issues, consider checking out our API, I think you'll find it valuable.

[maxixam]

it is looking for an element but can't find it, seems the tool stops working until it is updated with the change from linkedin.

[mostafamdy]

you can check pull requests I found the solution there
https://github.com/joeyism/linkedin_scraper/pulls

[sach-12]

#209

[turk]

Hey @kumashankar-mbai
if you are considering using a paid solution, I suggest you have a look at our API. https://rapidapi.com/rockapis-rockapis-default/api/linkedin-api8

[JackBlair87]

https://medium.com/@jackblair87/writing-a-live-follower-count-python-program-for-my-website-5e34631582d3

[wisdomcsharp]

You can easily scrape thousands of profiles, using services linkedin outreach services like Linkedly AI

Then connecting your flows with a webhook to services like zapier..

Works smoothly for me