Data/Databricks Engineer
- Джерело:
- djinni.co
Що робити
- Design, build, and maintain scalable ETL/ELT pipelines on Databricks using PySpark and SQL.
- Implement and evolve Delta Lake tables following a medallion (bronze/silver/gold) architecture.
- Develop batch and, where needed, streaming data processing jobs (Structured Streaming).
- Build and maintain CI/CD for Databricks notebooks and jobs (Databricks Asset Bundles, Repos, Git-based workflows).
- Orchestrate pipelines with Databricks Workflows, Azure Data Factory, Airflow, or similar tools.
Що пропонуємо
- Databricks certification (Data Engineer Associate or Professional).
- Experience with streaming technologies such as Kafka or Azure Event Hubs.
- Experience with dbt for transformation and testing.
- Solid Python software-engineering practices — testing, packaging, typing.
- Infrastructure-as-code experience (Terraform).
Схожі вакансії
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot