← Усі вакансії

Senior Data Engineer

Рівень:
senior
Джерело:
djinni.co
Відгукнутись на вакансію →

Що робити

  • Ingestion Architecture & GCP Foundation:
  • Architect, build, and optimize scalable job creation, batching, and high-throughput ingestion pipelines hosted on GCP.
  • Implement serverless and containerized data pipelines using GCP infrastructure (BigQuery, Dataflow, Pub/Sub, Cloud Storage, GKE).
  • Enterprise ETL, CDC & Incremental Processing:
  • Design robust Change Data Capture (CDC) and incremental update workflows to enable fast delta synchronization across platforms.

Що очікуємо

  • Google Cloud Platform (GCP): 4+ years of production experience with core GCP data technologies (BigQuery, Dataflow, Cloud Pub/Sub, GKE, Google Cloud Storage).
  • Database & Query Engines: Deep technical proficiency with both Snowflake (warehousing, semi-structured queries, integration layers) and ClickHouse (real-time aggregation, low-latency columnar storage, indexing).
  • Enterprise ETL / CDC: Proven experience architecting CDC pipelines and incremental delta loading for multi-terabyte dataset scale.
  • Data Transformation & Orchestration: Hands-on mastery of dbt Core/Cloud and Apache Airflow in an enterprise CI/CD setting (e.g., GitHub Actions).
  • Programming Skills: Advanced skills in Python and SQL; familiarity with Go, Java, or Scala is a strong plus.

Схожі вакансії

З блогу Trackr

Усі статті →

Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot