JobsIntelligence Documentation¶
ETL and data engineering workspace for the JobsIntelligence system. Built with Python, Apache Airflow, Apify, and MySQL.
Pipelines¶
JobsAustria ETL¶
Scrapes job listings from the Austrian job market (AMS and other portals), stores them in a MySQL cache, and progressively enriches them with company data, location data, and full job details.
| Document | Description |
|---|---|
| Introduction & Data Flow | End-to-end sequence diagram with implementation status |
| Implementation | Per-stage class references and known issues |
| Classes | Auto-generated class and method reference |
| Database Schema | ERD and data lifecycle for Stage 2 tables |