Senior/Middle Data Engineer

Що очікуємо

• Python as a working language for data engineering (not just scripting)
• SQL fluently: window functions, complex joins, reading and reasoning about execution plans
• Spark / PySpark: transformations, aggregations, window functions, UDFs — and enough understanding of shuffle, skew and partitioning to open a Spark UI and explain why a job is slow
• AWS data stack: S3, Glue, Athena, Lambda, Step Functions, IAM (equivalent depth in GCP/Azure is fine)
• Lakehouse fundamentals: Parquet, Iceberg (or Delta/Hudi) — partitioning, compaction, schema evolution, snapshots