
Senior BigData Engineer
Pine Software
- Формат:
- повний remote
- Рівень:
- senior
- Джерело:
- jobs.dou.ua
Що робити
- Design, build, and maintain scalable data pipelines using PySpark, SQL, and Databricks for batch and streaming workloads.
- Implement and manage CDC (Change Data Capture) pipelines to sync data from source systems into the data platform.
- Build and optimize ETL/ELT workflows, ensuring data quality, reliability, and performance at scale.
- Design and evolve data models (e.g., medallion architecture — bronze/silver/gold layers) within the Databricks lakehouse.
- Collaborate with data analysts, data scientists, and product teams to understand data requirements and deliver reliable datasets.
Що очікуємо
- 6+ years of overall software/data engineering experience, with a solid foundation as a Software Engineer who transitioned into data.
- Strong proficiency in Python and SQL.
- Proven track record of designing, building, and scaling ETL/ELT pipelines using PySpark and Databricks.
- Hands-on experience implementing and managing Change Data Capture (CDC) and streaming pipelines.
- Practical knowledge of Databricks Lakehouse, Medallion Architecture, and dimensional data modeling (Star Schema, Kimball).
Схожі вакансії
З блогу Trackr
Усі статті →Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot


