Admin

Admin

Manage sources, companies, and monitor ingestion.

What do these buttons do?
Run Ingestion — Crawl all active sources and add new articles to the database.
Extract Entities — Scan new articles for company/person/topic mentions (regex-based, fast).
Gemini Enrich — Use Gemini AI to extract richer entities from high-scoring articles. Requires GEMINI_API_KEY.
Run Discovery — Find new sources, companies, and topics not yet tracked.
Taxonomy Discovery — Detect new vendors, associations, and roles; adds to Discovery page.
Sync Known Universe — Push accepted taxonomy candidates into the scoring engine.
Weekly Report — Summarise new and promoted entities for the week.
Relevance Cleanup — Delete articles below score 15 and re-score borderline ones.

Pipeline KPIs

Auto-ingestion: 0 */2 * * *
18
Articles today
183 last 7 days
99%
Crawl success
8265 runs last 7 days
72
Avg relevance score
across all indexed articles
91%
Clustered
articles assigned to a cluster
Top sources by volume
Google News: "chief communications officer"141
Google News: "Kommunikationschef"128
Google News: AMEC99
Google News: Cision94
Google News: Muck Rack68

Infrastructure

26 MB
Database size
+52 KB/day est. at current rate
1.5 MB
Projected monthly growth
~52 KB/day × 30 · ~2 KB per article
3.8 GB
Projected monthly traffic
898.0 MB measured last 7d
1,007
Requests / day
90 sources · avg every 129 min
0%
Store rate (7d)
183 stored / 301,172 fetched100% filtered by score gate

Recent Crawl Runs

View all →
SourceStatusFoundNewStarted
Prowly Magazinesuccess1008/3/2026, 10:00:48 AM
Google Alertsuccess008/3/2026, 10:00:48 AM
Mention Blogsuccess908/3/2026, 10:00:48 AM
turi2success10008/3/2026, 10:00:46 AM
Silicon Anglesuccess3008/3/2026, 10:00:46 AM

Admin Sections