Discussions

• 1 You must be logged in to vote

  💡

  [Feature Request]: crwl cmd does not have version flag

  ⚙️ New Feature requests that are still not reviewed

  mbn18 started Nov 7, 2025 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  ❓

  How to prevent crawling extremely long page?

  ryangawei asked Nov 5, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 0 You must be logged in to vote

  ❓

  Set time limit and interrupt crawling that takes too long

  ryangawei asked Nov 5, 2025 in Forums - Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature Request]: Batch size as a parameter for deep crawling

  ⚙️ New Feature requests that are still not reviewed

  nguyenthengocdev started Nov 4, 2025 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  💡

  [Feature Request]: Would there have a rust version?

  ⚙️ New Feature requests that are still not reviewed

  lucasjinreal started Nov 2, 2025 in Feature requests

  

  

  0
• 3 You must be logged in to vote

  ❓

  How to aggressively optimize for speed (Target < 5s) even with content loss?

  vika55iii asked Oct 31, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  ❓

  Deep Crawling using arun_many()

  exaucersk asked Mar 18, 2025 in Forums - Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  ❓

  how to filter network_requests when set capture_network_requests=True

  wangning182 asked Oct 30, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  Running on Heroku

  khmob asked Oct 29, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  ❓

  User directory setup for managed browsers for a Heroku deployed app

  vivekthoppil asked Jul 9, 2025 in Forums - Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  How to handle client side redirects and not HTTP redirects?

  Olliejp started Oct 28, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Should check_robots_txt be True by default?

  ttoommmmiiee started Oct 24, 2025 in General

  

  

  0
• 2 You must be logged in to vote

  ❓

  How do we use proxies with managed browsers?

  michael-deng asked Aug 22, 2025 in Forums - Q&A · Unanswered

  

  

  1
• 3 You must be logged in to vote

  ❓

  is there any option to use crawl4IA for automatic PDF downloading?

  Roman-Kasianenko asked Oct 20, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  ❓

  Task_id not returned

  veleinfobip asked Mar 12, 2025 in Forums - Q&A · Unanswered

  

  

  

  

  3
• 2 You must be logged in to vote

  💡

  Can you make a llms.txt file for latest .md files

  ✨ Enhancement Improvement on an existing feature

  Kjdragan started Dec 7, 2024 in Feature requests

  

  

  

  

  6
• 1 You must be logged in to vote

  💡

  [Feature Request]: requeue url if it comes from a different context (parent_url)

  ⚙️ New Feature requests that are still not reviewed

  pivuong started Oct 10, 2025 in Feature requests

  

  

  0
• 2 You must be logged in to vote

  ❓

  Deterministic execution: Something like an LLM compilation into LLM-free deterministic selectors

  nnWhisperer asked Oct 6, 2025 in Forums - Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  LLMExtractionStrategy returns empty results despite successful crawl & scrape

  birdalugur asked Aug 29, 2025 in Forums - Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  ❓

  Can't crawl in a ipynb file

  SaravanaPandian-9852 asked Sep 26, 2025 in Forums - Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  ❓

  How to normalize extracted data in Crawl4AI?

  abdefi asked Sep 27, 2025 in Forums - Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  ❓

  How to set endpoint when using cli?

  flytam asked Sep 26, 2025 in Forums - Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  ❓

  How to extract XPaths for all elements on a page using Crawl4AI?

  Dronanaik asked Sep 21, 2025 in Forums - Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  ❓

  how list type works?

  UncleFB asked Sep 17, 2025 in Forums - Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  💡

  [Feature Request]: support for custom transforms via function calling

  ⚙️ New Feature requests that are still not reviewed

  PorridgeBear started Sep 12, 2025 in Feature requests

  

  

  0