# ATLAS Operations Log

---

## February 11, 2026

### RAG Pipeline — Bulk Ingestion Complete

- **RAG v3.0 API** running at `http://localhost:8099` (container: `rag-api`)
- Ingested **9,016 files** from `/mnt/media/References` into Qdrant vector DB
- **229 failed** (mostly transient timeouts — retryable via `/retry-failed`)
- **27,255 chunks** indexed in Qdrant collection `references`
- Hybrid search enabled: dense (bge-m3 1024-dim) + sparse (BM25) + reranking
- 2 Whisper GPU nodes for audio transcription (medium model, Blackwell SM_120)
- Docling for PDF/HTML/DOCX extraction

### CISA KEV Full Catalog Ingestion

- Ingested all **1,513 CISA Known Exploited Vulnerabilities** from the federal catalog
- Source: `https://www.cisa.gov/sites/default/files/feeds/known_exploited_vulnerabilities.json`
- Each CVE saved as structured text with vendor, product, description, remediation dates
- Stored in `/mnt/media/References/feeds/cisa_kev/`
- Completed in ~4 minutes (lightweight plaintext path, no Whisper/Docling needed)

### Feed Ingestion System

- Rewrote `ingest_feeds_v2.py` to work with RAG v3.0 API (old script called dead Phase 3 scripts)
- Configured feeds in `/opt/rag/docs/feeds.json`:
  - **CISA KEV** (JSON) — 1,513 items
  - **Docker Blog** (RSS) — 10 items
  - **Ubuntu Security Notices** (RSS) — 10 items
  - **GitHub Blog** (RSS) — 10 items
  - **Traefik Blog** (RSS) — configured, 0 items fetched
- State tracked in `/opt/rag/state/feeds_state_v2.json` to avoid re-ingesting
- Host/container path translation: `/mnt/media/References` ↔ `/mnt/references`

### OpenWebUI RAG Filter

- Filter `rag_context_filter` already installed and active in OpenWebUI
- Calls `POST /retrieve` on every chat message
- Score threshold: 0.3, max context: 8,000 chars, top-k: 8
- Users at `https://ai.guapo613.beer` get automatic RAG context injection

### Grafana RAG Dashboard

- Prometheus scraping `rag-api` at `192.168.1.21:8099/metrics`
- Dashboard provisioned at `https://grafana.guapo613.beer`
- Panels: ingest rate, duration histograms, file counts by status, query latency

### Dashboard Deployment

- Next.js dashboard built and deployed as container `dashboard`
- Accessible at `https://dashboard.guapo613.beer` via Traefik (HTTPS confirmed 200)
- Monitors: Docker containers, UniFi network, Synology NAS, Grafana links
- Source: `/opt/dashboard/`

### Dead Code Cleanup

- Archived 11 obsolete Phase 3 scripts to `/opt/rag/scripts/_archived/`:
  - `explain_api.py`, `scan_books.py`, `ingest_file.py`, `ingest.py`
  - `extract_text.py`, `safe_fetch.py`, `transcribe.py`, `qdrant_init.py`
  - `bootstrap.sh`, `requirements.txt`, `ingest_feeds.py`

### n8n Morning Ops Digest (ATLAS-01)

- Imported `ATLAS-01-morning-ops-digest.json` into n8n via CLI
- Workflow activated — triggers daily at 7:00 AM ET
- Flow: Cron → Prometheus service status + Docker container list → Summary → LLM digest
- Set up n8n owner account: `mblanke@gmail.com` / `Powers4w!`
- n8n UI: `https://n8n.guapo613.beer`
- 4 total workflows in n8n (3 existing RAG-related + ATLAS-01)

### Infrastructure State

| Service | Container | Status | URL |
|---------|-----------|--------|-----|
| RAG API | `rag-api` | Running (8099) | `http://localhost:8099` |
| Qdrant | `qdrant` | Running (6333) | — |
| OpenWebUI | `openwebui` | Healthy | `https://ai.guapo613.beer` |
| LiteLLM | `llm-router` | Running (4000) | `https://llm.guapo613.beer` |
| Traefik | `traefik` | Running (80/443) | — |
| Grafana | `grafana` | Running | `https://grafana.guapo613.beer` |
| n8n | `n8n` | Running (5678) | `https://n8n.guapo613.beer` |
| Dashboard | `dashboard` | Running (3000) | `https://dashboard.guapo613.beer` |
| Docling | `docling` | Running (5001) | — |
| Whisper Node 1 | — | Running | `100.110.190.11:8200` |
| Whisper Node 2 | — | Running | `100.110.190.12:8200` |

### Key Paths

| Path | Purpose |
|------|---------|
| `/opt/rag/app/main.py` | RAG v3.0 API (719 lines) |
| `/opt/rag/app/config.py` | Settings & env vars |
| `/opt/rag/scripts/ingest_feeds_v2.py` | Feed ingestion script |
| `/opt/rag/docs/feeds.json` | Feed source configuration |
| `/opt/rag/data/state.db` | SQLite ingestion state |
| `/opt/rag/openwebui-rag-filter.py` | OpenWebUI filter source |
| `/opt/ai-stack/` | AI stack compose & data |
| `/opt/dashboard/` | Next.js dashboard source |
| `/mnt/media/References/` | Document library (host mount) |
| `/mnt/media/References/feeds/` | Ingested feed articles |

---