The crawler supports only HTTP/1.1 right now, which breaks compability with sites that require HTTP/2 or higher. https://tosdr.atlassian.net/browse/TDC-7