mirror of
https://github.com/mblanke/Gov_Travel_App.git
synced 2026-03-01 14:10:22 -05:00
mblanke
66b72d5f74
- Added openFlightsService.js to fetch and cache OpenFlights airport/airline/routes data - Validates airport codes exist in OpenFlights database (6072+ airports) - Generates realistic flights using major international airlines - Creates varied routing options: direct, 1-stop, 2-stop flights - Updated flightService.js to use OpenFlights as primary source before Amadeus - OpenFlights as fallback if Amadeus unavailable or returns no results - No API keys or authentication required - Cached locally to avoid repeated network requests - Realistic pricing, times, and stop locations Docker container rebuilt with OpenFlights integration.
Gov_Travel_App
Overview
This repository contains a Python scraper that collects travel rate tables from the NJC and accommodation listings, then stores the raw tables and normalized entries in a SQLite database.
Setup
python -m venv .venv
source .venv/bin/activate
pip install -e .
Run the scraper
python -m gov_travel.main --db data/travel_rates.sqlite3
The database includes:
raw_tablesfor every scraped HTML table.rate_entriesfor parsed rate rows (country/city/province + rate fields).exchange_ratesfor parsed currency rates.accommodationsfor parsed lodging listings.
If a field is not detected by the heuristics, the full row is still preserved in raw_tables and the raw_json columns for deeper post-processing.