Noah Levitt 46e2542e41 Merge branch 'robots-allow-failed-fetch' into ait-qa ...

* robots-allow-failed-fetch:
  treat a failed fetch (e.g. socket timeout) of robots.txt the same way as http errors: full allow

2017-10-06 12:00:58 -07:00

..

src

Merge branch 'robots-allow-failed-fetch' into ait-qa

2017-10-06 12:00:58 -07:00

pom.xml

Formating fixes in POM file.

2016-08-19 19:47:47 -07:00