Files
heritrix3/engine/src/webapps/selftest/RobotsExclusion/included.html
T

11 lines
182 B
HTML

<html>
<head>
<title>File to include</title>
</head>
<body>
<h1>File to include</h1>
<p>This file should NOT be excluded by the adjacent robots.txt.</p>
</body>
</html>