mirror of
https://github.com/internetarchive/heritrix3.git
synced 2026-11-15 10:20:47 +00:00
add test case for robots.txt with extraneous leading whitespace and missing blank lines
add test case for robots.txt with extraneous leading whitespace and missing blank lines