Middle Data Engineer (#5706)

Що робити

• Develop and maintain scalable data pipelines using S3, Apache Iceberg, Glue Data Catalog, EMR, Airflow (MWAA), Python, and PySpark.
• Work with data across medallion layers, from source ingestion to reusable business entities, dimensional models, and analytics-ready datasets.
• Integrate data from various source systems, including databases, APIs, business applications, and file-based sources.
• Implement data transformations and contribute to building end-to-end data products, including scheduled data deliveries and serverless workloads using services such as AWS Lambda and S3.
• Apply automated testing and data quality practices across data pipelines and contribute to metadata management, cataloguing, lineage, and documentation using DataHub and AWS services.