Senior Data Engineer (Python)
Edvantis, Львів, Ряшів (Польща)
- Формат:
- повний remote
- Рівень:
- senior
- Джерело:
- jobs.dou.ua
Що робити
- Design, build, and maintain scalable ETL/ELT pipelines on Databricks using PySpark and Delta Lake
- Define and evolve data models and the lakehouse architecture (bronze/silver/gold layers)
- Build and secure data exchange between AWS and Databricks, using S3 and other AWS sources and sinks
- Develop Python back-end services and APIs that serve or consume data products, and deploy them on AWS
- Write and optimize complex SQL for transformations, reporting & analytics, and tune performance on both Spark and relational databases
Що очікуємо
- 5+ years of commercial experience in Data Engineering, including 3+ years of hands-on work with Databricks (clusters/jobs, notebooks, Delta Lake, Unity Catalog, Workflows)
- Strong PySpark skills: transformations, joins, window functions, and performance tuning
- Proven experience in designing ETL/ELT pipelines, including incremental loads, CDC, idempotency, and error handling & recovery
- Advanced SQL knowledge: query optimization, complex analytical queries, and data modeling (dimensional, normalized, medallion architecture)
- Solid experience with relational databases (PostgreSQL, MySQL, or MS SQL Server)
Схожі вакансії
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot