Senior Data Engineer, Databricks
- Рівень:
- senior
- Джерело:
- djinni.co
Що робити
- Design and build the target Databricks architecture, and plan the migration from the current AWS stack
- Build and maintain production data pipelines: ingestion, transformation, and orchestration
- Own data quality, including the checks and alerts that catch problems before the client does
- Design the data models the analytics and machine learning work sits on
- Support the pipelines you build: monitoring, alerting, and the on-call reality of production data
Що очікуємо
- Five or more years in data engineering or software development
- At least three years of production Databricks work
- Deep experience with Spark, Delta Lake, and Unity Catalog
- Has planned and executed at least one migration onto Databricks from another platform, and can walk through the challenges
- Expert Python: clean modular code, comfortable with optimization and profiling
Що пропонуємо
- Databricks certification
- Deep AWS experience specifically, since that is the platform we are migrating from
- dbt, Airflow, or a similar transformation and orchestration framework
- Machine learning pipeline experience, since models run on top of what you build
- Background in utilities, energy, telecoms, or another regulated industry
Схожі вакансії
- Data Analyst (Vulnerability Data and Qualys Analysis)Devox Software
- Lead / Senior Data Engineer (Azure Databricks)MeGaDevsenior
- Manufacturing Data Lead / Data Engineering LeadNDA Recruitmentlead
Senior Data Engineer — Data Platform & OrchestrationDeep Knowledge Group$2 500 - $3 500 на місяцьremotesenior- Senior Data Engineer - Data Platform and OrchestrationDeep Knowledge Groupsenior
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot