Alex Osborne 4e8bda1a07 ExtractorHTML: Add obeyRelNofollow option ...

When enabled this option causes regular links annotated with rel=nofollow to not be extracted. This is useful for sites that use rel=nofollow to hint crawler traps.

2025-01-13 15:34:38 +09:00

..

src

ExtractorHTML: Add obeyRelNofollow option

2025-01-13 15:34:38 +09:00

testdata/selftest

Correct spelling mistakes.

2018-11-04 19:49:37 +09:00

.cvsignore

…

pom.xml

Update pom.xml for 3.6.1-SNAPSHOT

2024-11-29 21:06:57 +09:00