← Усі вакансії

Senior Big Data Software Engineer

Pine Software
Формат:
повний remote
Рівень:
senior
Джерело:
jobs.dou.ua
Відгукнутись на вакансію →

Що робити

  • Design, build, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and Databricks.
  • Implement and manage Change Data Capture (CDC) pipelines to seamlessly ingest data from source systems into the data platform.
  • Design and evolve data models using the Medallion Architecture (Bronze, Silver, Gold layers) within the Databricks Lakehouse.
  • Provision, configure, and manage cloud infrastructure as code using Terraform.
  • Optimize complex SQL queries and Spark jobs to guarantee high performance, reliability, and data quality at scale.

Що очікуємо

  • 6+ years of overall software/data engineering experience, with a solid foundation as a Software Engineer who transitioned into data.
  • Strong proficiency in Python and SQL.
  • Proven track record of designing, building, and scaling ETL/ELT pipelines using PySpark and Databricks.
  • Hands-on experience implementing and managing Change Data Capture (CDC) and streaming pipelines.
  • Practical knowledge of Databricks Lakehouse, Medallion Architecture, and dimensional data modeling (Star Schema, Kimball).

Схожі вакансії

З блогу Trackr

Усі статті →

Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot