lee/heritrix3
1
0
Fork 0
mirror of https://github.com/internetarchive/heritrix3.git synced 2026-09-25 07:05:49 +00:00
Code Issues Packages Projects Releases Wiki Activity

do not require "+" (plus sign) before @OPERATOR_CONTACT_URL@ in user-agent -- many bots including googlebot have the +, but some don't, so having it in the default template seems sufficient

Browse Source
This commit is contained in:
Noah Levitt
2014-09-05 12:59:17 -07:00
parent 035a7b0a08
commit df7d3b506c
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
modules/src/main/java/org/archive/modules/CrawlMetadata.java
+1 -1
View File
@@ -201,7 +201,7 @@ implements UserAgentProvider,
protected static Validator VALIDATOR = new BeanFieldsPatternValidator(
CrawlMetadata.class,
"userAgentTemplate",
"^.*\\+@OPERATOR_CONTACT_URL@.*$",
"^.*\\@OPERATOR_CONTACT_URL@.*$",
"You must supply a userAgentTemplate value that includes " +
"the string \"@OPERATOR_CONTACT_URL@\" where your crawl" +
"contact URL will appear.",