23 Commits

Author SHA1 Message Date
Safi 5f02b3dfe1 fix graspologic optional, fall back to networkx louvain, add privacy section 2026-04-06 14:02:28 +01:00
Safi 6dc07e5f99 add PyPI badge, set homepage to PyPI 2026-04-06 01:27:48 +01:00
Safi 90fac738e2 README: explain PreToolUse hook behavior in detail 2026-04-06 01:25:32 +01:00
Safi b37f187767 README: fix CI badge to v2, update curl URL, add how it works, graphify claude install section 2026-04-06 01:16:09 +01:00
Safi a7fc2493f0 v2: confidence scores, hyperedges, rationale extraction, git hooks, Claude Code hooks
- confidence_score required on every edge (INFERRED: 0.4-0.9, EXTRACTED: 1.0, AMBIGUOUS: 0.1-0.3)
- semantically_similar_to edges for non-obvious cross-file conceptual links
- hyperedges for 3+ node group relationships - fixed cache and merge pipeline that was silently dropping them
- check_semantic_cache returns 4-tuple including cached_hyperedges
- extract.py: mine the "why" - module/class/function docstrings and rationale comments (# NOTE: # IMPORTANT: # HACK: # WHY: # RATIONALE: # TODO: # FIXME:) as rationale_for nodes
- skill.md: rationale_for in relation schema, doc files extract design rationale
- obsidian output opt-in (--obsidian flag) - default output is graph.html + graph.json + GRAPH_REPORT.md only
- hooks.py: post-checkout hook added alongside post-commit - graph rebuilds on branch switch
- claude install: writes .claude/settings.json PreToolUse hook on Glob/Grep - Claude checks graph before searching raw files
- README updated with all v2 features
2026-04-06 00:58:55 +01:00
Safi 494f519bf4 README: highlight multimodal capability upfront 2026-04-05 23:43:59 +01:00
Safi e4bc87a284 README: clarify any folder works, clean up usage section 2026-04-05 22:48:23 +01:00
Safi 0a31c0862b add git commit hook - auto-rebuilds graph after every commit 2026-04-05 22:40:34 +01:00
Safi 2a8b6c16ad fix test_watch: update import after _run_update renamed to _notify_only 2026-04-05 20:58:23 +01:00
Safi 014758f61d README: clarify --watch auto-sync behavior for code vs docs 2026-04-05 20:20:34 +01:00
Safi 154919bb64 correct benchmark numbers — token reduction scales with corpus size, small corpora ~1x 2026-04-05 19:44:34 +01:00
Safi 546fc0b346 README: add --watch to usage, describe --wiki in What you get 2026-04-05 17:15:35 +01:00
Safi 5ae2be8ca7 Update README: add --wiki to usage and output tree 2026-04-05 17:09:02 +01:00
Safi 1cd52f191e shorten README - cut design principles, files section, marketing padding 2026-04-05 00:31:42 +01:00
Safi 8708333484 feat: vis.js HTML graph, token reduction benchmark, repo cleanup
- Replace pyvis with custom vis.js renderer: node size by degree,
  click-to-inspect panel with clickable neighbors, search box,
  community filter, physics clustering by community
- HTML graph generated by default on every run (no --html flag needed)
- Token reduction benchmark auto-runs after every /graphify on corpora >5k words
- Fix 292 edge warnings: silently skip stdlib/external edges in build.py
- Fix build() to merge extractions before building (cross-extraction edges were dropped)
- Add 5 HTML renderer tests (223 total)
- Remove unnecessary files: lib/, tests/eval_attention.py, misplaced eval reports
- Add graphify-out/ and .graphify_*.json to .gitignore
- Bump version to 0.1.4, remove pyvis dependency
- README: token reduction as top-level selling point, vis.js in tech stack,
  graph.html in output listing, correct test count and install command
2026-04-05 00:20:56 +01:00
Safi a7d1969f02 docs: update surprising connections description, test count
style: replace all em dashes with hyphens

fix: explain hidden .graphify/ folder in skill output and README

fix: rename .graphify/ to graphify-out/ so output is visible by default
2026-04-05 00:20:56 +01:00
Safi a7f910667d feat: GraphML export (--graphml flag) for Gephi and yEd 2026-04-05 00:20:56 +01:00
Safi cf7f42d3e7 docs: lead with Karpathy problem → graphify answer framing
fix: add pytest to CI install step

docs: reframe README as Claude Code skill, fix worked/ description

fix: use graphifyy on PyPI until graphify name is reclaimed

fix: pyproject.toml structure, URLs, description; README clarifications

feat: keywords, CHANGELOG, requires note, CI end-to-end install check
2026-04-05 00:20:56 +01:00
Safi 24bcd6d448 docs: CI, architecture guide, worked examples, README fixes
- Add GitHub Actions CI workflow (Python 3.10 and 3.12)
- Add CI badge to README
- Add ARCHITECTURE.md: pipeline overview, module table, schema, how to
  add a language extractor, security summary
- Move eval reports from tests/ to worked/httpx/ and worked/mixed-corpus/
- Fix README: test count 163→212, language table (13 languages via
  tree-sitter), extract.py description, worked examples links

benchmark: 8.8x token reduction on nanoGPT + minGPT + micrograd

- Run AST extraction on 29 Python files across 3 Karpathy repos
- 177 nodes, 246 edges, 17 communities (Leiden)
- 8.8x avg token reduction vs naive full-corpus context stuffing
- Notable: micrograd cleanly splits into engine/nn communities;
  nanoGPT model vs training loop correctly separated
- Honest: stdlib import noise flagged, config isolates documented

benchmark: 71.5x token reduction on mixed corpus (code+papers+images)

Full run: nanoGPT+minGPT+micrograd + 5 research papers + 4 images
285 nodes, 340 edges, 53 communities
Average BFS query: 1,726 tokens vs 123,488 naive (71.5x)
Code-only (AST) sub-benchmark: 8.8x on 13k-word corpus
2026-04-05 00:20:56 +01:00
Safi 81a43f028f feat: 13-language AST support and token benchmark
Java, C, C++, Ruby, C#, Kotlin, Scala, PHP via tree-sitter (13 total)
benchmark.py measures BFS subgraph tokens vs corpus tokens
5 skill bug fixes (cohesion crash, dead step, missing MCP tool)
2026-04-04 18:56:38 +01:00
Safi 0b7460a9e3 perf+fix: parallel extraction, faster imports, bug fixes
45x faster cluster import, 135x faster detect, parallel subagent extraction,
auto-exclude venvs/caches, suggest_questions fix, manifest fix, install CLI
2026-04-04 18:56:38 +01:00
Safi ce47198be1 feat: Claude Code skill, Obsidian vault, install, tests
skill.md with full pipeline steps, Obsidian as default output (canvas, tags,
dataview, graph colors), two-command install, 71 tests, .gitignore, deps
2026-04-04 18:53:43 +01:00
Safi 77966a7622 feat: core pipeline
detect, extract (AST + call-graph), build, cluster, analyze, report, export
PDF extraction, tree-sitter AST, pyvis HTML, schema validation
2026-04-04 18:52:44 +01:00