Details
-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
None
-
None
Description
The issue is that failure to retrieve robots.txt from pbs.twimg.com results in failure to harvest other content from the same host, including the main twitter stylesheets. There is a patch to H3 (from Nov 2017) which we need to include.