The Quiet Shift: Why Your Website Needs to Become AI-Ready
Search is shifting from blue links to AI answers. We audited 300 sites — Tranco top-100, a random...
May 12, 2026Interon Site Knowledge Graph
Transform any website into a structured knowledge graph with AI-powered entity extraction, relationship mapping, and intelligent question generation. Built by Interon, South Africa.
What Does This Tool Do?
Site Knowledge Graph is an intelligent web crawler and knowledge extraction system that analyzes websites to create structured, machine-readable knowledge bases. Perfect for AI training, content analysis, and data-driven insights.
Automated
Fully automated extraction and analysis
Export Formats
Multiple output formats for any use case
Use Cases
Unlimited applications and scenarios
How It Works
1. Submit URL
Enter any website URL with custom depth and page limits
2. Intelligent Crawl
Respects robots.txt, handles JavaScript, and extracts clean content
3. Entity Extraction
AI identifies entities: organizations, products, services, concepts
4. Build Graph
Maps relationships between entities to create knowledge graph
5. Generate Questions
Creates AI-ready question sets derived from content and relationships
6. Export Report
Download in multiple formats: PDF, JSON, CSV
The Comprehensive Report
Each analysis generates a detailed, multi-section report that provides deep insights into the website's content and structure:
Site Overview
Domain info, crawl status, timestamps, and metadata about the analyzed website
Crawl Summary
Total pages, depth analysis, fetch methods (HTTP vs JavaScript), and crawl duration
Pages & Structure
Complete page inventory with URLs, titles, depth levels, and entity counts
Entity Summary
All extracted entities with types, confidence scores, mentions, and relationships
Relationships Map
Connections between entities with relationship types, weights, and sources
Question Bank
AI-generated questions grouped by type and complexity level with confidence scores
Powerful Export Options
Every report comes with multiple export formats designed for different use cases. All exports are generated from the same analysis data, ensuring consistency:
📄 PDF Report
Print-ready, professionally formatted document with all sections, tables, and visualizations. Perfect for presentations and documentation.
🤖 AI-Ready JSON
Structured JSON format optimized for AI/ML pipelines, RAG systems, and programmatic processing. Includes full entity graph with relationships.
📊 CSV Exports
Three separate CSV files:
- Pages CSV: URL, title, depth, status, word count, entity count
- Entities CSV: Name, type, source, confidence, mention count, relations
- Relationships CSV: From entity, relation type, to entity, weight, source
Perfect for Excel analysis, database imports, and custom processing.
❓ Question Bank Exports
AI-generated questions in JSON and CSV formats with question text, type, level, confidence, and source entities. Ready for training chatbots, creating FAQs, or testing comprehension models.
Key Features
🛡️ Ethical & Compliant Crawling
- Respects robots.txt and crawl-delay directives
- Permission-first approach - only crawl authorized sites
- Rate limiting to avoid server overload
- Duplicate detection via content hashing
🧠 Intelligent Extraction
- AI-powered entity recognition (organizations, products, services, concepts)
- Automatic relationship detection and mapping
- Confidence scoring for every extraction
- Source tracking for full traceability
⚡ Real-Time Progress Tracking
- Live progress bar showing pages processed
- Phase indicators: Crawling → Building Graph → Generating Report
- Auto-refresh interface for seamless monitoring
- Error handling with detailed diagnostics
📊 Rich Question Generation
- 7 Question Types: Definition, How-To, Capability, Relationship, Coverage, Comparison, Gap Analysis
- 4 Complexity Levels: Content Chunk, Page, Entity, Knowledge Graph
- Confidence scores for answer reliability
- AI guidance for interrogation best practices
Use Cases
AI Training Data
Generate structured datasets for training chatbots, RAG systems, and knowledge-based AI models
Competitive Analysis
Analyze competitor websites to understand their offerings, messaging, and structure
Content Audits
Review your own website's content structure, entity coverage, and information architecture
Knowledge Graphs
Build enterprise knowledge graphs from public documentation and resources
Documentation Mining
Extract structured information from technical docs, wikis, and help centers
Educational Content
Create Q&A datasets and study materials from educational websites
Technical Architecture
Stack: Node.js + TypeScript + Fastify
Database: PostgreSQL (structured data) + Redis (queue/cache)
Crawling: HTTP + Playwright (JavaScript rendering)
Extraction: AI-powered entity recognition
Deployment: Railway (managed services)
Features:
✓ Type-safe with Prisma ORM
✓ Redis-backed job queue
✓ Parallel processing
✓ Content deduplication
✓ Relationship graph building
✓ Multi-format exports
Ready to Extract Knowledge?
Transform any website into structured knowledge in minutes. Start with a free AI Readiness audit or contact Interon for a full Knowledge Graph report.
Run Free AI Readiness Audit Contact Interon