Generator doesn't crawl when on production #62
Description
Do you want to request a feature or report a bug?
Bug
What is the current behavior?
When I run the generator from my localhost, to crawl my online website, it crawls all the pages at it should be. But when I run the crawler from my online site (to crawl the same site) it crawls only the home page and it gives me no errors or warnings.