Empty content types in JSONlines output

[oepen]

When looking at some HPLT 2.0 data (slice 42 of Wide15), it is not uncommon to see "c":"" (some 27k of about 16m documents). Is it possible that there was no information about content type in the HTTP response recorded in the underlying WARC file?

[ZJaume]

It is possible. I have no access to the WARCs though. Will need to check.

[ZJaume]

Investigated from a sample a few documents with empty content types. All of them were missing the field or having it empty in the WARC (they were all from wide10 and wide12). Except for one document that had the content type missing and the URL was from a different document. I extracted that WARC with the current w2t master and it does not happen. Probably it is not related to this issue, but wanted to check.