mirror of
https://github.com/mblanke/Dashboard.git
synced 2026-03-01 12:10:20 -05:00
4.4 KiB
4.4 KiB
ATLAS Operations Log
February 11, 2026
RAG Pipeline — Bulk Ingestion Complete
- RAG v3.0 API running at
http://localhost:8099(container:rag-api) - Ingested 9,016 files from
/mnt/media/Referencesinto Qdrant vector DB - 229 failed (mostly transient timeouts — retryable via
/retry-failed) - 27,255 chunks indexed in Qdrant collection
references - Hybrid search enabled: dense (bge-m3 1024-dim) + sparse (BM25) + reranking
- 2 Whisper GPU nodes for audio transcription (medium model, Blackwell SM_120)
- Docling for PDF/HTML/DOCX extraction
CISA KEV Full Catalog Ingestion
- Ingested all 1,513 CISA Known Exploited Vulnerabilities from the federal catalog
- Source:
https://www.cisa.gov/sites/default/files/feeds/known_exploited_vulnerabilities.json - Each CVE saved as structured text with vendor, product, description, remediation dates
- Stored in
/mnt/media/References/feeds/cisa_kev/ - Completed in ~4 minutes (lightweight plaintext path, no Whisper/Docling needed)
Feed Ingestion System
- Rewrote
ingest_feeds_v2.pyto work with RAG v3.0 API (old script called dead Phase 3 scripts) - Configured feeds in
/opt/rag/docs/feeds.json:- CISA KEV (JSON) — 1,513 items
- Docker Blog (RSS) — 10 items
- Ubuntu Security Notices (RSS) — 10 items
- GitHub Blog (RSS) — 10 items
- Traefik Blog (RSS) — configured, 0 items fetched
- State tracked in
/opt/rag/state/feeds_state_v2.jsonto avoid re-ingesting - Host/container path translation:
/mnt/media/References↔/mnt/references
OpenWebUI RAG Filter
- Filter
rag_context_filteralready installed and active in OpenWebUI - Calls
POST /retrieveon every chat message - Score threshold: 0.3, max context: 8,000 chars, top-k: 8
- Users at
https://ai.guapo613.beerget automatic RAG context injection
Grafana RAG Dashboard
- Prometheus scraping
rag-apiat192.168.1.21:8099/metrics - Dashboard provisioned at
https://grafana.guapo613.beer - Panels: ingest rate, duration histograms, file counts by status, query latency
Dashboard Deployment
- Next.js dashboard built and deployed as container
dashboard - Accessible at
https://dashboard.guapo613.beervia Traefik (HTTPS confirmed 200) - Monitors: Docker containers, UniFi network, Synology NAS, Grafana links
- Source:
/opt/dashboard/
Dead Code Cleanup
- Archived 11 obsolete Phase 3 scripts to
/opt/rag/scripts/_archived/:explain_api.py,scan_books.py,ingest_file.py,ingest.pyextract_text.py,safe_fetch.py,transcribe.py,qdrant_init.pybootstrap.sh,requirements.txt,ingest_feeds.py
n8n Morning Ops Digest (ATLAS-01)
- Imported
ATLAS-01-morning-ops-digest.jsoninto n8n via CLI - Workflow activated — triggers daily at 7:00 AM ET
- Flow: Cron → Prometheus service status + Docker container list → Summary → LLM digest
- Set up n8n owner account:
mblanke@gmail.com/Powers4w! - n8n UI:
https://n8n.guapo613.beer - 4 total workflows in n8n (3 existing RAG-related + ATLAS-01)
Infrastructure State
| Service | Container | Status | URL |
|---|---|---|---|
| RAG API | rag-api |
Running (8099) | http://localhost:8099 |
| Qdrant | qdrant |
Running (6333) | — |
| OpenWebUI | openwebui |
Healthy | https://ai.guapo613.beer |
| LiteLLM | llm-router |
Running (4000) | https://llm.guapo613.beer |
| Traefik | traefik |
Running (80/443) | — |
| Grafana | grafana |
Running | https://grafana.guapo613.beer |
| n8n | n8n |
Running (5678) | https://n8n.guapo613.beer |
| Dashboard | dashboard |
Running (3000) | https://dashboard.guapo613.beer |
| Docling | docling |
Running (5001) | — |
| Whisper Node 1 | — | Running | 100.110.190.11:8200 |
| Whisper Node 2 | — | Running | 100.110.190.12:8200 |
Key Paths
| Path | Purpose |
|---|---|
/opt/rag/app/main.py |
RAG v3.0 API (719 lines) |
/opt/rag/app/config.py |
Settings & env vars |
/opt/rag/scripts/ingest_feeds_v2.py |
Feed ingestion script |
/opt/rag/docs/feeds.json |
Feed source configuration |
/opt/rag/data/state.db |
SQLite ingestion state |
/opt/rag/openwebui-rag-filter.py |
OpenWebUI filter source |
/opt/ai-stack/ |
AI stack compose & data |
/opt/dashboard/ |
Next.js dashboard source |
/mnt/media/References/ |
Document library (host mount) |
/mnt/media/References/feeds/ |
Ingested feed articles |