Open
Description
Describe the bug
I have used scholarly for quite a time. Everything was okay. But at one moment, when I use
scholarly.search_pubs('python')It doesn't end.
These log lines repeat infinitely:
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
To Reproduce
Nothing special:
scholarly.search_pubs('python')Expected behavior
Either a publication (iterator for publications), or an error.
Screenshots
None.
Desktop (please complete the following information):
- Proxy service: None
- python version: 3.12
- OS: Arch Linux
- Version 1.7.11
Do you plan on contributing?
No
Additional context
Full logs:
```plain
Python 3.13.2 (main, Feb 5 2025, 08:05:21) [GCC 14.2.1 20250128] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> from scholarly import scholarly
>>> import logging
>>> logging.basicConfig(level=logging.DEBUG)
>>> it = scholarly.search_pubs("python")
INFO:scholarly:Getting https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33
DEBUG:httpcore.connection:connect_tcp.started host='scholar.google.com' port=443 local_address=None timeout=5 socket_options=None
DEBUG:httpcore.connection:connect_tcp.complete return_value=
DEBUG:httpcore.connection:start_tls.started ssl_context= server_hostname='scholar.google.com' timeout=5
DEBUG:httpcore.connection:start_tls.complete return_value=
DEBUG:httpcore.http11:send_request_headers.started request=
DEBUG:httpcore.http11:send_request_headers.complete
DEBUG:httpcore.http11:send_request_body.started request=
DEBUG:httpcore.http11:send_request_body.complete
DEBUG:httpcore.http11:receive_response_headers.started request=
DEBUG:httpcore.http11:receive_response_headers.complete return_value=(b'HTTP/1.1', 302, b'Found', [(b'Location', b'https://www.google.com/sorry/index?continue=https://scholar.google.com/scholar%3Fhl%3Den%26q%3Dpython%26as_vis%3D0%26as_sdt%3D0,33&hl=en&q=EgRTqtIaGPfnkL8GIiwgUSqU8W8HRSo5J5H4FbXtT7lg5Egl49APmrPv4C4WNIFmHZLkHvIkX5fkKTICclJaAUM'), (b'Date', b'Wed, 26 Mar 2025 17:05:59 GMT'), (b'Pragma', b'no-cache'), (b'Expires', b'Fri, 01 Jan 1990 00:00:00 GMT'), (b'Cache-Control', b'no-store, no-cache, must-revalidate'), (b'Content-Type', b'text/html; charset=UTF-8'), (b'Server', b'HTTP server (unknown)'), (b'Content-Length', b'431'), (b'X-XSS-Protection', b'0'), (b'Alt-Svc', b'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000')])
INFO:httpx:HTTP Request: GET https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33 "HTTP/1.1 302 Found"
DEBUG:httpcore.http11:receive_response_body.started request=
DEBUG:httpcore.http11:receive_response_body.complete
DEBUG:httpcore.http11:response_closed.started
DEBUG:httpcore.http11:response_closed.complete
DEBUG:httpcore.connection:connect_tcp.started host='www.google.com' port=443 local_address=None timeout=5 socket_options=None
DEBUG:httpcore.connection:connect_tcp.complete return_value=
DEBUG:httpcore.connection:start_tls.started ssl_context= server_hostname='www.google.com' timeout=5
DEBUG:httpcore.connection:start_tls.complete return_value=
DEBUG:httpcore.http11:send_request_headers.started request=
DEBUG:httpcore.http11:send_request_headers.complete
DEBUG:httpcore.http11:send_request_body.started request=
DEBUG:httpcore.http11:send_request_body.complete
DEBUG:httpcore.http11:receive_response_headers.started request=
DEBUG:httpcore.http11:receive_response_headers.complete return_value=(b'HTTP/1.1', 429, b'Too Many Requests', [(b'Date', b'Wed, 26 Mar 2025 17:06:00 GMT'), (b'Pragma', b'no-cache'), (b'Expires', b'Fri, 01 Jan 1990 00:00:00 GMT'), (b'Cache-Control', b'no-store, no-cache, must-revalidate'), (b'Content-Type', b'text/html'), (b'Server', b'HTTP server (unknown)'), (b'Content-Length', b'3277'), (b'X-XSS-Protection', b'0'), (b'Alt-Svc', b'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000')])
INFO:httpx:HTTP Request: GET https://www.google.com/sorry/index?continue=https://scholar.google.com/scholar%3Fhl%3Den%26q%3Dpython%26as_vis%3D0%26as_sdt%3D0,33&hl=en&q=EgRTqtIaGPfnkL8GIiwgUSqU8W8HRSo5J5H4FbXtT7lg5Egl49APmrPv4C4WNIFmHZLkHvIkX5fkKTICclJaAUM "HTTP/1.1 429 Too Many Requests"
DEBUG:httpcore.http11:receive_response_body.started request=
DEBUG:httpcore.http11:receive_response_body.complete
DEBUG:httpcore.http11:response_closed.started
DEBUG:httpcore.http11:response_closed.complete
INFO:scholarly:Got a captcha request.
DEBUG:selenium.webdriver.common.selenium_manager:Selenium Manager binary found at: /mnt/data/projects/ai-paper-gen/.venv/lib/python3.13/site-packages/selenium/webdriver/common/linux/selenium-manager
DEBUG:selenium.webdriver.common.selenium_manager:Executing process: /mnt/data/projects/ai-paper-gen/.venv/lib/python3.13/site-packages/selenium/webdriver/common/linux/selenium-manager --browser firefox --debug --language-binding python --output json
DEBUG:selenium.webdriver.common.selenium_manager:geckodriver not found in PATH
DEBUG:selenium.webdriver.common.selenium_manager:firefox detected at /usr/bin/firefox
DEBUG:selenium.webdriver.common.selenium_manager:Running command: /usr/bin/firefox -v
DEBUG:selenium.webdriver.common.selenium_manager:Output: "Mozilla Firefox 136.0.1"
DEBUG:selenium.webdriver.common.selenium_manager:Detected browser: firefox 136.0.1
DEBUG:selenium.webdriver.common.selenium_manager:Required driver: geckodriver 0.36.0
DEBUG:selenium.webdriver.common.selenium_manager:geckodriver 0.36.0 already in the cache
DEBUG:selenium.webdriver.common.selenium_manager:Driver path: /home/ruslan/.cache/selenium/geckodriver/linux64/0.36.0/geckodriver
DEBUG:selenium.webdriver.common.selenium_manager:Browser path: /usr/bin/firefox
DEBUG:selenium.webdriver.common.service:Started executable: `/home/ruslan/.cache/selenium/geckodriver/linux64/0.36.0/geckodriver` in a child process with pid: 7751 using 0 to output -3
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session {'capabilities': {'firstMatch': [{}], 'alwaysMatch': {'browserName': 'firefox', 'acceptInsecureCerts': True, 'moz:debuggerAddress': True, 'pageLoadStrategy': , 'browserVersion': None, 'moz:firefoxOptions': {'binary': '/usr/bin/firefox', 'prefs': {'remote.active-protocols': 3}, 'args': ['--headless']}}}}
DEBUG:urllib3.connectionpool:Starting new HTTP connection (1): localhost:53431
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":{"sessionId":"e2b872d2-c58b-44f3-96d0-949c7541fca4","capabilities":{"acceptInsecureCerts":true,"browserName":"firefox","browserVersion":"136.0.1","moz:accessibilityChecks":false,"moz:buildID":"20250311232648","moz:debuggerAddress":"127.0.0.1:48675","moz:geckodriverVersion":"0.36.0","moz:headless":true,"moz:platformVersion":"6.13.7-arch1-1","moz:processID":7758,"moz:profile":"/tmp/rust_mozprofile2IPIjJ","moz:shutdownTimeout":60000,"moz:webdriverClick":true,"moz:windowless":false,"pageLoadStrategy":"normal","platformName":"linux","proxy":{},"setWindowRect":true,"strictFileInteractability":false,"timeouts":{"implicit":0,"pageLoad":300000,"script":30000},"unhandledPromptBehavior":"dismiss and notify","userAgent":"Mozilla/5.0 (X11; Linux x86_64; rv:136.0) Gecko/20100101 Firefox/136.0"}}} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '802', 'date': 'Wed, 26 Mar 2025 17:06:00 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {'url': 'https://scholar.google.com'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '14', 'date': 'Wed, 26 Mar 2025 17:06:00 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '39', 'date': 'Wed, 26 Mar 2025 17:06:02 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '39', 'date': 'Wed, 26 Mar 2025 17:06:02 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {'url': 'https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":null} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '14', 'date': 'Wed, 26 Mar 2025 17:06:02 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:03 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:05 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
xDEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '.rc-doscaptcha-body'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="gs_captcha_ccl"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[{"element-6066-11e4-a52e-4f735466cecf":"6c95cf1c-e25b-45e4-868f-502e46851aae"}]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '90', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="recaptcha"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:GET http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url {}
DEBUG:urllib3.connectionpool:http://localhost:53431 "GET /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/url HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":"https://scholar.google.com/scholar?hl=en&q=python&as_vis=0&as_sdt=0,33"} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '82', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
DEBUG:selenium.webdriver.remote.remote_connection:POST http://localhost:53431/session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements {'using': 'css selector', 'value': '[id="captcha-form"]'}
DEBUG:urllib3.connectionpool:http://localhost:53431 "POST /session/e2b872d2-c58b-44f3-96d0-949c7541fca4/elements HTTP/1.1" 200 0
DEBUG:selenium.webdriver.remote.remote_connection:Remote response: status=200 | data={"value":[]} | headers=HTTPHeaderDict({'content-type': 'application/json; charset=utf-8', 'cache-control': 'no-cache', 'content-length': '12', 'date': 'Wed, 26 Mar 2025 17:06:06 GMT'})
DEBUG:selenium.webdriver.remote.remote_connection:Finished Request
```