Senior Data Engineer — Real Time Streams

Globaldev Group

Що робити

Designing, implementing, and operating stateful Apache Flink streaming pipelines: keyed state, windowing, watermarks, timers, side outputs, custom sources/sinks.
Designing, developing, deploying, and maintaining Change Data Capture (CDC) pipelines using Flink CDC or Debezium, moving operational database changes into the streaming platform with correct snapshot/incremental handling, schema evolution, and downstream idempotency.
Building and operating Kafka and Kafka Connect pipelines: topic and partition design, source/sink connectors in distributed mode, schema and converter management, and deadletter routing.
Owning the path from Kafka → Flink → Postgres / TimescaleDB / ClickHouse / BigQuery, including schema design, idempotency strategy, batch tuning, and observability.
Diagnosing and fixing production issues: checkpoint failures, backpressure, state growth, sink slowness, autoscaler oscillation, restart loops.

5+ years of professional software/data engineering experience, with strong Java expertise.
Production experience with Apache Flink and stateful real-time streaming pipelines.
Strong Apache Kafka experience, including Kafka Connect, consumer groups, partitions, delivery guarantees, and schema management.
Hands-on CDC experience using Debezium or Flink CDC.
Experience designing and operating Kafka → Flink → database/data warehouse pipelines in production.

Знайдено через trackr.help/jobs · Канал: @trackrhelp · Бот для персональних сповіщень: @trackrhelpBot