Senior Data Engineer (GovTech and Public Sector)
- Рівень:
- senior
- Джерело:
- djinni.co
Що робити
- Design and implement data ingestion pipelines for batch and streaming data
- Configure and maintain data orchestration workflows (Airflow, NiFi) and CI/CD automation for data processes
- Design and organize data layers within Data Lake architecture (HDFS, Iceberg, S3)
- Build and maintain secure and governed data environments using Apache Ranger, Atlas, and SDX
- Develop SQL queries and optimize performance for analytical workloads in Hive/Impala
Що очікуємо
- Proven experience in building and maintaining large-scale data pipelines (batch and streaming)
- Strong knowledge of data engineering fundamentals: ETL/ELT, data governance, data warehousing, Medallion architecture
- Strong SQL skills for Data Warehouse data serving
- Minimum 3 years of experience in Python or Scala for data processing
- Hands-on experience with Apache Spark, Kafka, Airflow, and distributed systems optimization
Схожі вакансії
- Senior GCP Data Engineer / Data Architect - Data Lake and On-Prem MigrationKozak Agencysenior
Middle Data Analyst (Business Data)UklonКиївremotemiddle
Senior Data Engineer (with Data Analyst skills) (#5040)N-iX, Київ, ЛьвівТернопільremotesenior- Senior Data Engineer (Databricks)Hire1$5 000 - $6 000 на місяцьsenior
- Data AnalystLuxoft
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot