From 021aeeaa20d3e14423ebf296cf506b44497b4d17 Mon Sep 17 00:00:00 2001 From: Andrew Jackson Date: Tue, 5 Feb 2019 10:25:54 +0000 Subject: [PATCH] Swapped original and link to make maintenance simpler. --- README.md | 71 ++++++++++++++++++++++++++++++++++++++++++++++++- dist/README.txt | 71 +------------------------------------------------ 2 files changed, 71 insertions(+), 71 deletions(-) mode change 120000 => 100644 README.md mode change 100644 => 120000 dist/README.txt diff --git a/README.md b/README.md deleted file mode 120000 index 34aa7fe9..00000000 --- a/README.md +++ /dev/null @@ -1 +0,0 @@ -dist/README.txt \ No newline at end of file diff --git a/README.md b/README.md new file mode 100644 index 00000000..c96bf635 --- /dev/null +++ b/README.md @@ -0,0 +1,70 @@ +Readme for Heritrix +==================== + +1. Introduction +2. Crawl Operators! +3. Getting Started +4. Developer Documentation +5. Release History +6. License + + +1) Introduction +---------------- + +Heritrix is the Internet Archive's open-source, extensible, web-scale, +archival-quality web crawler project. Heritrix (sometimes spelled heretrix, or +misspelled or missaid as heratrix/heritix/heretix/heratix) is an archaic word +for heiress (woman who inherits). Since our crawler seeks to collect and +preserve the digital artifacts of our culture for the benefit of future +researchers and generations, this name seemed apt. + + +2) Crawl Operators! +-------------------- + +Heritrix is designed to respect the robots.txt + exclusion directives and META robots +tags . Please consider the +load your crawl will place on seed sites and set politeness policies +accordingly. Also, always identify your crawl with contact information in the +User-Agent so sites that may be adversely affected by your crawl can contact +you or adapt their server behavior accordingly. + + +3) Getting Started +------------------- + +See the User Manual, available from . +For API documentation, see +and + + +5) Latest Releases +------------------- + +Information about releases can be found at + + +6) License +----------- + +Heritrix is free software; you can redistribute it and/or modify it +under the terms of the Apache License, Version 2.0: + + http://www.apache.org/licenses/LICENSE-2.0 + +Some individual source code files are subject to or offered under other +licenses. See the included LICENSE.txt file for more information. + +Heritrix is distributed with the libraries it depends upon. The +libraries can be found under the 'lib' directory, and are used under +the terms of their respective licenses, which are included alongside +the libraries in the 'lib' directory. + diff --git a/dist/README.txt b/dist/README.txt deleted file mode 100644 index c96bf635..00000000 --- a/dist/README.txt +++ /dev/null @@ -1,70 +0,0 @@ -Readme for Heritrix -==================== - -1. Introduction -2. Crawl Operators! -3. Getting Started -4. Developer Documentation -5. Release History -6. License - - -1) Introduction ----------------- - -Heritrix is the Internet Archive's open-source, extensible, web-scale, -archival-quality web crawler project. Heritrix (sometimes spelled heretrix, or -misspelled or missaid as heratrix/heritix/heretix/heratix) is an archaic word -for heiress (woman who inherits). Since our crawler seeks to collect and -preserve the digital artifacts of our culture for the benefit of future -researchers and generations, this name seemed apt. - - -2) Crawl Operators! --------------------- - -Heritrix is designed to respect the robots.txt - exclusion directives and META robots -tags . Please consider the -load your crawl will place on seed sites and set politeness policies -accordingly. Also, always identify your crawl with contact information in the -User-Agent so sites that may be adversely affected by your crawl can contact -you or adapt their server behavior accordingly. - - -3) Getting Started -------------------- - -See the User Manual, available from . -For API documentation, see -and - - -5) Latest Releases -------------------- - -Information about releases can be found at - - -6) License ------------ - -Heritrix is free software; you can redistribute it and/or modify it -under the terms of the Apache License, Version 2.0: - - http://www.apache.org/licenses/LICENSE-2.0 - -Some individual source code files are subject to or offered under other -licenses. See the included LICENSE.txt file for more information. - -Heritrix is distributed with the libraries it depends upon. The -libraries can be found under the 'lib' directory, and are used under -the terms of their respective licenses, which are included alongside -the libraries in the 'lib' directory. - diff --git a/dist/README.txt b/dist/README.txt new file mode 120000 index 00000000..32d46ee8 --- /dev/null +++ b/dist/README.txt @@ -0,0 +1 @@ +../README.md \ No newline at end of file