Why this role exists:
This role exists to design, build, and maintain streaming data solutions based on Apache Kafka and related technologies, ensuring reliable data processing, integration, and testing of streaming applications.
What you’ll drive:
Streaming pipelines & data flow
Build and maintain data pipelines using Apache Kafka, including topics, partitions, and consumer group tuning.
Implement and manage Kafka Connect source and sink connectors for integrations.
Streaming application development
Design and develop stateful streaming applications using Kafka Streams or Flink with Java (and Scala where applicable).
Ensure data consistency and schema evolution using Schema Registry (Avro).
Quality & testing
Write and maintain unit and integration tests for streaming topologies.
What makes you a GR8 fit:
Must-have
Commercial experience in software engineering with strong proficiency in Java (Scala is a plus).
Understanding of Apache Kafka architecture and internals.
Experience working with Apache Flink.
Experience with Schema Registry and schema evolution strategies.
Knowledge of serialization formats such as Avro and JSON.
Experience using SQL for processing large datasets.
Nice-to-have
Experience running Kafka and/or Flink on Kubernetes.
Familiarity with monitoring tools such as Prometheus and Grafana for streaming metrics.
Understanding of stream processing semantics.
Experience with CI/CD pipelines for streaming applications.
