← Усі вакансії

Senior BigData Engineer

Pine Software
Формат:
повний remote
Рівень:
senior
Джерело:
jobs.dou.ua
Відгукнутись на вакансію →

Що робити

  • Design, build, and maintain scalable data pipelines using PySpark, SQL, and Databricks for batch and streaming workloads.
  • Implement and manage CDC (Change Data Capture) pipelines to sync data from source systems into the data platform.
  • Build and optimize ETL/ELT workflows, ensuring data quality, reliability, and performance at scale.
  • Design and evolve data models (e.g., medallion architecture — bronze/silver/gold layers) within the Databricks lakehouse.
  • Collaborate with data analysts, data scientists, and product teams to understand data requirements and deliver reliable datasets.

Що очікуємо

  • 6+ years of overall software/data engineering experience, with a solid foundation as a Software Engineer who transitioned into data.
  • Strong proficiency in Python and SQL.
  • Proven track record of designing, building, and scaling ETL/ELT pipelines using PySpark and Databricks.
  • Hands-on experience implementing and managing Change Data Capture (CDC) and streaming pipelines.
  • Practical knowledge of Databricks Lakehouse, Medallion Architecture, and dimensional data modeling (Star Schema, Kimball).

Схожі вакансії

З блогу Trackr

Усі статті →

Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot