mason5052 364fbd4010 docs: add headless crawler integration RFC ...

Add examples/proposals/headless_crawler_integration.md, a docs-only RFC proposing an optional, tool-agnostic crawler / URL discovery capability for PentAGI agents. Candidate backends are katana, crawlergo, rad, and jsfinder, framed as candidates with no mandatory default. The RFC keeps dictionary fuzzing (ffuf/dirsearch) unchanged, defines structured discovery artifacts (URLs, forms, parameters, JavaScript endpoints, status codes, source page, depth, scope decision), and keeps crawler URL discovery separate from the BrowserOS MCP interactive browser backend.

Refs #336

2026-06-13 22:33:11 -04:00

..

configs

feat(providers): Update model configurations for various LLM providers: qwen, kimi, glm, deepseek, gemini

2026-05-28 15:41:17 +03:00

guides

docs: update links in configuration and flow execution documents, add directory for proposals

2026-04-30 10:09:03 +03:00

prompts

Apply suggestions from code review

2026-04-29 01:07:47 +04:00

proposals

docs: add headless crawler integration RFC

2026-06-13 22:33:11 -04:00

reports

repo final state

2026-03-26 06:16:07 +03:00

tests

feat(qwen): enhance agent configurations with thinking control parameters

2026-05-29 00:06:47 +03:00