mirror of
https://github.com/internetarchive/heritrix3.git
synced 2026-10-25 16:19:20 +00:00
add test case for robots.txt with extraneous leading whitespace and missing blank lines
add test case for robots.txt with extraneous leading whitespace and missing blank lines