gojomo affa3b672c HER-1620 Tolerate trailing '*' in robots disallow (& allow?) rules ...

* Robotstxt.java
    trim single trailing '*' if present (assume unintentional or redundant)

2010-04-13 22:46:23 +00:00

..

.settings

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

src

HER-1620 Tolerate trailing '*' in robots disallow (& allow?) rules

2010-04-13 22:46:23 +00:00

.classpath

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

.project

copy 'springy' branch to heritrix3

2009-05-11 22:56:36 +00:00

pom.xml

post-3.0.0 release build

2009-12-05 23:48:38 +00:00