nlevitt 26f34c1b8c HER-1547 some sites may require an 'Accept' header ...

* FetchHTTP.java
    "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"
    by default - this is what my firefox 4.0 for mac sends
* profile-crawler-beans.cxml
    commented-out default value

2011-04-25 20:43:17 +00:00

.settings

commit project-specific eclipse settings

2009-11-11 02:05:30 +00:00

commons

HER-741 Make extractors interrogate for charset

2011-04-22 18:43:18 +00:00

dist

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

engine

HER-1547 some sites may require an 'Accept' header

2011-04-25 20:43:17 +00:00

modules

HER-1547 some sites may require an 'Accept' header

2011-04-25 20:43:17 +00:00

.classpath

Followup to r7127 - add jna to eclipse classpath

2011-04-13 00:54:26 +00:00

.project

Fix for [HER-1524] speculativeFixup in ExtractorJS should maintain URL scheme

2009-05-12 22:09:22 +00:00

java.hprof.txt

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-cpusamples

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

java.hprof.txt-heapsites

prep for 3.0.0 release

2009-12-05 09:28:19 +00:00

pom.xml

Post 3.1.0-beta

2011-04-15 22:28:52 +00:00

S

Description

No description provided

heritrixjavawarcwebcrawling

14 MiB

Languages

Java 93.3%

HTML 2.6%

Rich Text Format 1.1%

JavaScript 1%

FreeMarker 0.8%

Other 1%