docs: add superscraper blog #2828
Conversation
| --- | ||
| slug: superscraper-with-crawlee | ||
| title: 'Inside implementing Superscraper with Crawlee.' | ||
| description: 'This blog explains how SuperScraper works, highlights its implementation details, and provides code snippets to demonstrate its core functionality.' |
There was a problem hiding this comment.
So far, the crawlee blog has only been about crawlee and we haven't mentioned Apify much. This is quite a change in direction. Are you sure we want to publish this here? Just to be sure.
There was a problem hiding this comment.
I think it's good to have such pieces, too; after all, best way to build Actors should be Crawlee. There will be more in future.
There was a problem hiding this comment.
in title its Superscraper, in description its SuperScraper
also, it feels weird to say "this blog", its a blogpost or article, "blog" is the platform where we serve it, where all the articles are, no?
| return crawler; | ||
| ``` | ||
|
|
||
| ### Mapping standby HTTP requests to Crawlee requests |
There was a problem hiding this comment.
These are just isolated functions and you need to browse the repo (or use a lot of imagination) to see how it all fits together. I'd appreciate a more top-down approach - maybe start with a code snippet with the big picture and then show how the individual functions are implemented?
Co-authored-by: Jan Buchar <[email protected]>
| --- | ||
| slug: superscraper-with-crawlee | ||
| title: 'Inside implementing Superscraper with Crawlee.' | ||
| description: 'This blog explains how SuperScraper works, highlights its implementation details, and provides code snippets to demonstrate its core functionality.' |
There was a problem hiding this comment.
in title its Superscraper, in description its SuperScraper
also, it feels weird to say "this blog", its a blogpost or article, "blog" is the platform where we serve it, where all the articles are, no?
| authors: [SauravJ, RadoC] | ||
| --- | ||
|
|
||
| [SuperScraper](https://github.com/apify/super-scraper) is an open-source Actor that combines features from various web scraping services, including [ScrapingBee](https://www.scrapingbee.com/), [ScrapingAnt](https://scrapingant.com/), and [ScraperAPI](https://www.scraperapi.com/). |
There was a problem hiding this comment.
Maybe add a link on the Actor word to https://docs.apify.com/platform/actors, so people are not confused by that. We don't use that in the crawlee docs much, only in the platform and deployment guides most likely.
|
|
||
| The following function stores a response object in the key-value map: | ||
|
|
||
| ```js |
There was a problem hiding this comment.
the code is TS since you have type hints in there, not JS, I can see the highlighting wouldn't be happy about this. most (if not all) examples here should use ts.
website/blog/authors.yml
Outdated
| url: https://github.com/chudovskyr | ||
| image_url: https://ca.slack-edge.com/T0KRMEKK6-U04MGU11VUK-7f59c4a9343b-512 | ||
| socials: | ||
| github: chudovskyr |
There was a problem hiding this comment.
keep the line break at the end of the file
Co-authored-by: Martin Adámek <[email protected]>
blog regarding superscraper approved by Lukas, Rado, and marketing