JobsIntelligence Documentation

ETL and data engineering workspace for the JobsIntelligence system. Built with Python, Apache Airflow, Apify, and MySQL.

---

Pipelines

JobsAustria ETL

Scrapes job listings from the Austrian job market (AMS and other portals), stores them in a MySQL cache, and progressively enriches them with company data, location data, and full job details.

Document	Description
Data Flow Diagram	End-to-end sequence diagram with implementation status
Implementation Details	Per-stage class references and known issues
Stage 2 — Class Diagram	Class diagram for Payload Sync
Stage 2 — Database Schema	ERD and data lifecycle for Stage 2 tables