Gov_Travel_App/docker-compose.yml at ae1f13d69e68fbdba0d51279a6f81a8b1ae96439 - Gov_Travel_App - Gitea: Git with a cup of tea

mblanke/Gov_Travel_App

mirror of https://github.com/mblanke/Gov_Travel_App.git synced 2026-03-01 14:10:22 -05:00

Files

mblanke 15094ac94b Add Python web scraper for NJC travel rates with currency extraction

- Implemented Python scraper using BeautifulSoup and pandas to automatically collect travel rates from official NJC website
- Added currency extraction from table titles (supports EUR, USD, AUD, CAD, ARS, etc.)
- Added country extraction from table titles for international rates
- Flatten pandas MultiIndex columns for cleaner data structure
- Default to CAD for domestic Canadian sources (accommodations and domestic tables)
- Created SQLite database schema (raw_tables, rate_entries, exchange_rates, accommodations)
- Successfully scraped 92 tables with 17,205 rate entries covering 25 international cities
- Added migration script to convert scraped data to Node.js database format
- Updated .gitignore for Python files (.venv/, __pycache__, *.pyc, *.sqlite3)
- Fixed city validation and currency conversion in main app
- Added comprehensive debug and verification scripts

This replaces manual JSON maintenance with automated data collection from official government source.

2026-01-13 09:21:43 -05:00

16 lines

272 B

YAML

Raw Blame History

 version: '3.8'
 services:
   govt-travel-app:
     build: .
     container_name: govt-travel-estimator
     ports:
       - "5001:5001"
     restart: unless-stopped
     environment:
       - NODE_ENV=production
     env_file:
       - .env
     volumes:
       - ./data:/app/data:ro