Skip to content
@apify

Apify

We're making the web more programmable.
README.md

Apify Banner

Apify is the largest ecosystem where developers build, deploy, and publish data extraction and web automation tools. We call them Actors.

discord X/Twitter youtube linkedin

Learn About Apify 🧑‍🎓

  • Find hundreds of ready-made Actors for your web scraping or automation project on Apify Store.
  • Learn everything about web scraping and automation with our free courses that will turn you into an expert scraping developer.
  • Publish your web scrapers as paid Actors on the Apify platform, attract people who need these solutions, and get regular passive income.
  • View our livestreams and video content at the Apify YouTube channel.
  • Learn more through tutorials and thought leadership content about web scraping on Apify Blog and Crawlee Blog.

We are hiring! 🕸️

Check out the open positions at Apify and help us make the web more programmable.

Pinned Loading

  1. crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Wo…

    Python 5.4k 365

  2. crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…

    TypeScript 17.2k 772

  3. apify-cli Public

    Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

    TypeScript 135 21

  4. proxy-chain Public

    Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.

    JavaScript 896 146

  5. got-scraping Public

    HTTP client made for scraping based on got.

    TypeScript 637 50

  6. fingerprint-suite Public

    Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.

    TypeScript 1.3k 126

Repositories

Showing 10 of 156 repositories
  • actor-whitepaper-web Public

    Documentation site for the Actor Programming Model – a fresh take on serverless microapps. Built with Astro.

    MDX 2 MIT 0 4 11 Updated Mar 21, 2025
  • impit Public

    impit | rust library for browser impersonation

    Rust 23 1 2 4 Updated Mar 21, 2025
  • crawlee-python Public

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

    Python 5,431 Apache-2.0 365 78 10 Updated Mar 21, 2025
  • apify-docs Public

    This project is the home of Apify's documentation.

    API Blueprint 32 Apache-2.0 87 78 (2 issues need help) 13 Updated Mar 21, 2025
  • proxy-chain Public

    Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.

    JavaScript 896 Apache-2.0 146 9 (1 issue needs help) 12 Updated Mar 21, 2025
  • actors-mcp-server Public

    Model Context Protocol (MCP) Server for Apify's Actors

    TypeScript 88 Apache-2.0 6 3 0 Updated Mar 21, 2025
  • actor-mastra-mcp-agent Public

    🤖 AI agent using mastra.ai with Apify MCP Server. 🚀 Runs queries via OpenAI models, taps Apify Actors for web data, and outputs to datasets. 🛠️

    3 Apache-2.0 1 2 1 Updated Mar 21, 2025
  • crawlee Public

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    TypeScript 17,212 Apache-2.0 772 140 (1 issue needs help) 20 Updated Mar 21, 2025
  • apify-client-python Public

    Apify API client for Python

    Python 58 Apache-2.0 12 9 0 Updated Mar 21, 2025
  • apify-cli Public

    Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

    TypeScript 135 21 49 (1 issue needs help) 11 Updated Mar 21, 2025
View all repositories