Senior Data Engineer - Data Platform and Orchestration
- Рівень:
- senior
- Джерело:
- djinni.co
Що робити
- Design and own the shared collection and enrichment framework: what is reusable, what stays source-specific, and where the line between them sits.
- Own orchestration end to end — scheduling, dependencies, retries, backfills, incremental and idempotent re-runs.
- Make entity resolution a permanent service rather than a per-project effort: blocking, matching, thresholds, and a defensible account of why a merge was made.
- Design the provenance model: every value traceable to its source, its retrieval date and the logic that transformed it, six months after the fact.
- Establish the staging-and-promotion rule and enforce it: nothing writes to production tables directly.
Що очікуємо
- Strong Python — you write services and pipelines, not notebooks.
- You have owned a data platform, not just tasks on one — orchestration, scheduling, monitoring, backfills.
- Airflow, Dagster or Prefect in production, with a considered view on why that one.
- SQL and PostgreSQL in depth — indexing, query plans, schema design, migrations.
- Entity resolution or record linkage across sources that disagree with each other, including how you measured whether it worked.
Схожі вакансії
З блогу Trackr
Усі статті →
Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot